Metadata-Version: 2.1
Name: spark-sql-to-sqlite
Version: 0.6
Description-Content-Type: text/markdown

# spark_sql_to_sqlite

Easily save a Spark dataframe into a SQLite database.

You can use this on Spark environments such as Databricks, where you have a `spark` variable available that represents the SparkContext.

Install it as follows:

```
%pip install spark-sql-to-sqlite
```

Then import it as follows:

```
from spark_sql_to_sqlite import spark_sql_to_sqlite
```

You can now use it as follows:

```
spark_sql_to_sqlite("SELECT * from {catalog}.{schema}.{table}", path_to_sqlite_db, table_name)
```

Example:
```
spark_sql_to_sqlite(spark, "SELECT * FROM hive_metastore.fire.bronze", "/tmp/fire.db", "bronze")
```

The above command will create a SQLite database at `/tmp/fire.db` if it doesn't already exists. It will create or replace the `bronze` table in this database and overwrite it with the results of the Spark SQL query
