Progress Checklist
Data Types
Functions | Supported ✅ ? |
---|---|
ArrayType | ⬜️ |
BinaryType | ⬜️ |
BooleanType | ⬜️ |
ByteType | ⬜️ |
DataType | ⬜️ |
DateType | ✅ |
DecimalType | ⬜️ |
DoubleType | ✅ |
FloatType | ✅ |
IntegerType | ✅ |
LongType | ✅ |
MapType | ⬜️ |
NullType | ⬜️ |
ShortType | ✅ |
StringType | ✅️ |
StructField | ⬜️ |
StructType | ⬜️ |
TimestampType | ✅️ |
DataFrame APIs
Functions
Functions | Accelerated ✅ ? |
---|---|
abs | ✅ |
acos | ✅️ |
acosh | ✅️ |
add_months | ⬜️ |
approxCountDistinct | ✅ |
asin | ✅️ |
asinh | ✅️ |
atan | ✅️ |
atanh | ✅️ |
atan2 | ⬜️ |
avg | ✅ |
ceil | ⬜️ |
conv | ⬜️ |
corr | ✅ |
cos | ⬜️ |
cosh | ✅️ |
count | ✅ |
countDistinct | ✅ |
cume_dist | ⬜️ |
current_date | ⬜️ |
current_timestamp | ⬜️ |
date_add | ⬜️ |
date_format | ⬜️ |
date_sub | ⬜️ |
date_trunc | ⬜️ |
datediff | ⬜️ |
dayofmonth | ⬜️ |
dayofweek | ⬜️ |
dayofyear | ⬜️ |
days | ⬜️ |
exp | ✅️ |
explode | ⬜️ |
explode_outer | ⬜️ |
expm1 | ⬜️ |
expr | ✅ |
factorial | ⬜️ |
isnan | ✅ |
isnull | ✅️ |
levenshtein | ⬜️ |
log | ✅️ |
log10 | ✅️ |
log1p | ✅️ |
log2 | ✅️ |
max | ✅ |
mean | ✅️ |
min | ✅ |
minute | ⬜️ |
month | ⬜️ |
months | ⬜️ |
months_between | ⬜️ |
next_day | ⬜️ |
nth_value | ⬜️ |
percent_rank | ⬜️ |
percentile_approx | ⬜️ |
pow | ✅️ |
quarter | ⬜️ |
radians | ⬜️ |
rank | ⬜️ |
second | ⬜️ |
shiftLeft | ⬜️ |
shiftRight | ⬜️ |
shiftRightUnsigned | ⬜️ |
signum | ⬜️ |
sin | ✅️ |
sinh | ✅️ |
size | ⬜️ |
skewness | ⬜️ |
slice | ⬜️ |
sort_array | ⬜️ |
soundex | ⬜️ |
split | ⬜️ |
sqrt | ✅️ |
stddev | ✅️ |
stddev_pop(col) | ⬜️ |
stddev_samp(col) | ⬜️ |
struct | ⬜️ |
substring | ✅ |
substring_index | ⬜️ |
sum) | ✅ |
sumDistinct | ⬜️ |
tan | ✅ |
tanh | ✅ |
timestamp_seconds | ⬜️ |
toDegrees | ⬜️ |
toRadians | ⬜️ |
upper | ⬜️ |
var_pop | ⬜️ |
var_samp | ⬜️ |
variance | ⬜️ |
weekofyear | ⬜️ |
when | ✅ |
window | ⬜️ |
year | ⬜️ |
years | ⬜️ |
Grouping
Functions | Supported ✅? |
---|---|
GroupedData.avg | ✅ |
GroupedData.count | ✅ |
GroupedData.max | ✅️ |
GroupedData.mean | ✅️ |
GroupedData.min | ✅️ |
GroupedData.pivot | ⬜️ |
GroupedData.sum | ✅ |