json.py

SparkJSON dataclass

Bases: IO[DataFrame]

IO for loading and saving JSON using Spark.

Example:

>>> from ordeq_spark import SparkJSON
>>> json = SparkJSON(
...     path="to.json"
... )

By default, Spark creates a directory on save. Use single_file if you want to write to a file instead:

>>> from ordeq_spark import SparkJSON
>>> json = SparkJSON(
...     path="to.json"
... ).with_load_options(single_file=True)