Total vulnerabilities in the database
Prior to Spark 2.3.3, in certain situations Spark would write user data to local disk unencrypted, even if spark.io.encryption.enabled=true. This includes cached blocks that are fetched to disk (controlled by spark.maxRemoteBlockSizeFetchToMem); in SparkR, using parallelize; in Pyspark, using broadcast and parallelize; and use of python udfs.
Software | From | Fixed in |
---|---|---|
apache / spark | 1.0.2 | 1.6.3.x |
apache / spark | 2.0.0 | 2.0.2.x |
apache / spark | 2.1.0 | 2.1.3.x |
apache / spark | 2.2.0 | 2.2.2.x |
apache / spark | 2.3.0 | 2.3.2 |
![]() |
- | 2.3.3 |