Software engineer for about 14 years mainly focused on OO languages such as C#, C++, PHP, Java. Since 2017 interested on distributed systems, machine learning and big data overall. Currently eager to learn more over Spark, Scala, Python, Kafka and ElasticSearch.

https://stackoverflow.com/questions/59195346/does-pyspark-changes-order-of-instructions-for-optimization/59792914#59792914

https://stackoverflow.com/questions/53843406/spark-copying-dataframe-columns-best-practice-in-python-pyspark/59547508#59547508

https://stackoverflow.com/questions/56031691/databricks-partitioning-w-relation-to-predicate-pushdown/56044258#56044258

https://stackoverflow.com/questions/60090491/regex-match-with-dataframe-column-values/60129474#60129474

https://stackoverflow.com/questions/61686883/scala-spark-flatten-array-of-key-value-structs/61751630#61751630

https://stackoverflow.com/questions/56039490/custom-sorting-based-on-the-content-of-an-external-array-with-scala-java-api/56047024#56047024

https://stackoverflow.com/questions/60326447/apache-spark-get-the-first-and-last-row-of-each-partition/60337377#60337377

https://stackoverflow.com/questions/62329722/get-column-of-list-of-ratings-with-0s-in-place-for-missing-ratings-in-pyspark/62335427#62335427

https://stackoverflow.com/questions/58697415/pyspark-looping-through-structtype-and-arraytype-to-do-typecasting-in-the-stru/59084765#59084765

https://stackoverflow.com/questions/60279160/compare-two-dataframes-pyspark/60284807#60284807