Skip to article frontmatterSkip to article content

Integrate with DuckDB

reasons to use duckdb, rather than a data lake, e.g. SQL views, SQL queries, etc. example reading delta lake?

from pfeed.storages.duckdb_storage import DuckDBStorage

import duckdb
from pprint import pprint
duckdb_files = DuckDBStorage.get_duckdb_files()
pprint(duckdb_files)
conn = duckdb.connect(str(duckdb_files[0]))