Metadata-Version: 2.3
Name: rustfs
Version: 0.1.0
Classifier: Programming Language :: Rust
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Operating System :: MacOS
Classifier: Operating System :: POSIX :: Linux
License-File: LICENSE
Requires-Python: >=3.8
Description-Content-Type: text/markdown; charset=UTF-8; variant=GFM

# Rust Filesystem




```python
import pandas as pd
from rustfs import RustFileSystem

df = pd.DataFrame({"name": ["Tom", "Joseph"], "age": [20, 22]})
df.to_parquet("s3://my-s3-bucket/df.parquet", storage_options={"access_key_id": "minio", "secret_access_key":"miniostorage", "endpoint": "http://localhost:30002"})


rfs = RustS3FileSystem(access_key_id="minio", secret_access_key="miniostorage", endpoint="http://localhost:30002", allow_http=True)
```


```python
from rustfs import RustFileSystem

rfs = RustFileSystem(access_key_id="minio", secret_access_key="miniostorage", endpoint="http://localhost:30002", allow_http=True)
fh = rfs.open("s3://my-s3-bucket/test.txt", "wb")

```


This is me and troy discussing things
```python
with open("s3://bucket/one_tb.file", "rb") as reader:
    with rustfs.open("s3://bucket/one_tb.copy", "wb") as writer:
        # rust writer needs to accept BinaryIO
        writer.write(reader)


with rfsopen("/local/one_tb.file", "rb") as reader:
    with rfsopen("s3://bucket/one_tb.copy", "wb") as writer:
        while True:
            b = reader.read(10)
            if not b:
                break
            writer.write(b)


with rustfs.open(""s3://bucket/one_tb.copy", "rb") as reader:
    reader.read()
```
