So happy with this accomplishment 😃. #pyspark #maven #scala #spark #awsglue

Spark Dag plan

Guess what is happening here ?

#Spark #Pyspark #PySpark #Data #dataengineering #codinglife

Please suggest some good resources to learn PySpark.

The mother gats be some kind of narcissist because why make everything awkward and about your feelings, on your daughters wedding day

🔊🚨 If you know of any Kaggle kernels, discussions or competitions that have Advanced ML/DL using Pyspark to handle data pipelines/model training, please do send it my way ! I'd like some more hands-on industry level practice as a crash course.

Feedback in my performance…

Why you should not use UDFs in Pyspark? 🤔
This was the first thing I tried out when learning pyspark and databricks!!

#Connect #SoftwareEngineer #SoftwareEngineer ing #DataScience #SQL #excel

PySpark Milestone Black Friday Sales Data | Hackerrank
#Hackerrank #Python #SciPy #MontyPython #Programmer #coding #Programming #Elections2024 #100daysofcodechallenge #developer
Python StackOverflow Monty Python Python Software Foundation Real Python Cool Python
Read More👇
neptuneworld.in/blog/pyspark-m…

Compare 300GB dataset with 2 GB dataset using pyspark
#dataengineering
reddit.com/r/dataengineer…

Polars syntax is so similar to Pyspark, it's like the designers knew their target audience from the beginning.

I am getting increasingly worried about the mental health of these young black women cast alongside white male actors. It is going to result in a consequence that nobody is ready for. I will stand by my opinion that these producers are using these women as cannon fodder.

#PySpark in 2023: A Year in Review
databricks.com/blog/pyspark-2…

PySpark Extract String JSON data into multiple Rows - 2 answers Believe, achieve, succeed at phpout.com/q/373355#webde… #webapplication #questionandanswer #questionoftheday |

📈 Leveraging our expertise in #DataAnalytics , we shaped campaigns and forecasted #COVID19 vaccination numbers using Python & PySpark. From Autumn 2022 to Spring ‘24, we played a crucial role. #DataScience #Healthcare

Put him in a human sized microwave

👐 Our role evolved from hands-on work to advisory, guiding subsequent campaigns. Recently, we shared Python/PySpark insights with SQL & Excel experts, a rewarding learning experience for all. 🤗 #DataAnalysis

I just published การใช้งาน KsqlDB หรือ PySpark Structured Streaming ในการจัดการ Streaming data (In Thai) link.medium.com/zwexdBGfDIb

📊 What is the difference between Pandas and Pyspark🚀
Pandas and pyspark both are python libaries for data manipulation and analysis, however there is a difference in their execution and processing architecture. Let’s go over some major differences between these two.
#sql #data

Join our live demo with Senior Software Architect, PO, Alexander Kolovos to learn more about this new module in Teradata’s Python library and see a step-by-step implementation of a workflow using a PySpark-based use case entirely on a Vantage system. ms.spr.ly/6016cFfrp

Amigos y colegas reclutadores, x favor, si alguien está en busqueda de un Data Engineer SR (+7 YOE) con exp en python, pyspark, flask, SQL, HIVE, DAX, C#, Scala, Databricks, P BI, R, ML, y más, ¿me avisan?

Tengo un gran perfil (y excelente persona) para recomendar.
AGRADEZCO DIF

oooh type inference works on dataclasses now in PySpark (and probably for awhile but I hadn't checked). that's happy :)