Metadata-Version: 2.1
Name: elementary-lineage
Version: 0.0.10
Summary: Presenting data lineage based on your data warehouse query history
Home-page: https://github.com/elementary-data/elementary-lineage
Author: Elementary
Author-email: or@elementary-data.com
License: UNKNOWN
Platform: UNKNOWN
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: Microsoft :: Windows
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Requires-Python: >=3.6.2
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: click
Requires-Dist: pyfiglet
Requires-Dist: snowflake-connector-python
Requires-Dist: dbt
Requires-Dist: networkx
Requires-Dist: sqllineage (==1.2.4)
Requires-Dist: pyvis
Requires-Dist: setuptools
Requires-Dist: sqlparse
Requires-Dist: tqdm
Requires-Dist: jinja2 (<3.0.0)
Requires-Dist: werkzeug (<2.0)
Requires-Dist: urllib3 (<1.26)

![](static/headline-git.png)

**Data lineage made simple, reliable, and automated.**  
Effortlessly track the flow of data, understand dependencies and analyze impact.

<img src="static/elementary_demo.gif" width="700"/>


## Features

* **Visualization:** In browser visual representation of the data lineage graph. 
* **DWH lineage:** Effortlessly map data flow in the data warehouse. 
* **Accuracy:** Reflects the actual state in the DWH.
* **Plug-and-play:** No need for code changes.

**Coming soon:**

* **Monitoring:** Present data about freshness, volume and schema on the lineage graph.
* **Lineage history:** Store data about lineage versions and changes.
* **Column level lineage:** Add column-level granularity.
* **Full lineage:** Integrate with downstream and upstream tools to create a full graph.

## Quick start

```bash
pip install elementary-lineage

# The tool is named edl (Elementary Data Lineage),
# run it to validate the installation:
edl --help
```

Now we need a connection file in a simple YAML called `profiles.yml`. [Here is a template](static/profiles.yml) to create a Snowflake connection profile.   
For further instructions go to our [quickstart page](https://docs.elementary-data.com/quickstart#requirements). 

If you use ![](static/dbt-16.png)[dbt](https://www.getdbt.com/), you can start right away by running this command with the path to your `profiles.yml` and the relevant profile name:

```bash
edl -d ~/profiles_dir -p <profile_name>
```

If you like what we are building, support us with <a href="https://github.com/elementary-data/elementary-lineage/stargazers"><img src="static/star_github.png" width="40"/></a>.
      

# Documentation

Our full documentation is [available here](https://docs.elementary-data.com/).

## Community & Support

For additional information and help, you can use one of these channels:

* ![](static/slack-16.png) [Slack](https://join.slack.com/t/elementary-community/shared_invite/zt-uehfrq2f-zXeVTtXrjYRbdE_V6xq4Rg) \(live chat with the team, feature requests, community support, discussions, etc.\)
* 📧 Contact us directly at [team@elementary-data.com](mailto:team@elementary-data.com)

## **Integrations**

* [x] **Snowflake** ![](static/snowflake-16.png)
* [ ] **BigQuery**  ![](static/bigquery-16.png) 
* [ ] **Redshift**  ![](static/redshift-16.png) 

Ask us for integrations on [Slack](https://join.slack.com/t/elementary-community/shared_invite/zt-uehfrq2f-zXeVTtXrjYRbdE_V6xq4Rg) or as a Github issue.

## **License**

Elementary lineage is licensed under Apache License 2.0. See the LICENSE file for licensing information.


