PySpark quiz

Test your PySpark knowledge with a free interactive quiz — 22 questions with answers and explanations. No signup needed to play.

What is a "broadcast variable" in PySpark?

1. What is a "broadcast variable" in PySpark?
2. How do you submit a PySpark application to run on a cluster?
3. What is Py4J's role in PySpark's architecture?
4. How do you cache a DataFrame in memory to avoid recomputing it across multiple actions?
5. What is a `SparkContext` (or `SparkSession` in modern PySpark)?
6. What does `df.repartition(n)` do?
7. What is the difference between a "transformation" and an "action" in PySpark's RDD/DataFrame model?
8. What does `df.filter(condition)` (or the equivalent `df.where(condition)`) do?
9. What is the relationship between PySpark's DataFrame API and Spark SQL?
10. How do you start an interactive PySpark shell?
11. What is an "accumulator" in PySpark?
12. What does `rdd.collect()` do, and why should it be used carefully on large datasets?

More quizzes