Search…
Snowflake

Description

The Snowflake offline store provides support for reading SnowflakeSources.
  • Snowflake tables and views are allowed as sources.
  • All joins happen within Snowflake.
  • Entity dataframes can be provided as a SQL query or can be provided as a Pandas dataframe. Pandas dataframes will be uploaded to Snowflake in order to complete join operations.
  • A SnowflakeRetrievalJob is returned when calling get_historical_features().
    • This allows you to call
      • to_snowflake to save the dataset into Snowflake
      • to_sql to get the SQL query that would execute on to_df
      • to_arrow_chunks to get the result in batches (Snowflake python connector docs)

Example

feature_store.yaml
1
project: my_feature_repo
2
registry: data/registry.db
3
provider: local
4
offline_store:
5
type: snowflake.offline
6
account: snowflake_deployment.us-east-1
7
user: user_login
8
password: user_password
9
role: sysadmin
10
warehouse: demo_wh
11
database: FEAST
Copied!
Configuration options are available in SnowflakeOfflineStoreConfig.
Last modified 2mo ago
Export as PDF
Copy link
Edit on GitHub