The list below contains the functionality that contributors are planning to develop for Feast

• Items below that are in development (or planned for development) will be indicated in parentheses.

• We welcome contribution to all items in the roadmap!

• Want to influence our roadmap and prioritization? Submit your feedback to this form.

• Want to speak to a Feast contributor? We are more than happy to jump on a call. Please schedule a time using Calendly.

• Data Sources

  • Redshift source

  • BigQuery source

  • Parquet file source

  • Kafka source (Planned for Q4 2021)

  • HTTP source

  • Snowflake source

  • Synapse source

• Offline Stores

  • Redshift

  • BigQuery

  • In-memory / Pandas

  • Custom offline store support

  • Hive (community maintained)

  • Snowflake

  • Synapse

• Online Stores

  • DynamoDB

  • Redis

  • Datastore

  • SQLite

  • Custom online store support

  • Postgres

  • Bigtable

  • Cassandra

• Streaming

  • Custom streaming ingestion job support

  • Streaming ingestion on AWS (Planned for Q4 2021)

  • Streaming ingestion on GCP

• Feature Engineering

  • On-demand Transformations (Development in progress. See RFC)

  • Batch transformation (SQL)

  • Streaming transformation

• Deployments

  • AWS Lambda (Development in progress. See RFC)

  • Cloud Run

  • Kubernetes

  • KNative

• Feature Serving

  • Python Client

  • REST Feature Server (Python) (Development in progress. See RFC)

  • gRPC Feature Server (Java) (See #1497)

  • Java Client

  • Go Client

  • Push API

  • Delete API

  • Feature Logging (for training)

• Data Quality Management

  • Data profiling and validation (Great Expectations) (Planned for Q4 2021)

  • Metric production

  • Training-serving skew detection

  • Drift detection

  • Alerting

• Feature Discovery and Governance

  • Python SDK for browsing feature registry

  • CLI for browsing feature registry

  • Model-centric feature tracking (feature services)

  • REST API for browsing feature registry

  • Feast Web UI (Planned for Q4 2021)

  • Feature versioning

  • Amundsen integration

The top-level namespace within Feast is a project. Users define one or more feature views within a project. Each feature view contains one or more features. These features typically relate to one or more entities. A feature view must always have a data source, which in turn is used during the generation of training datasets and when materializing feature values into the online store.

Project

Projects provide complete isolation of feature stores at the infrastructure level. This is accomplished through resource namespacing, e.g., prefixing table names with the associated project. Each project should be considered a completely separate universe of entities and features. It is not possible to retrieve features from multiple projects in a single request. We recommend having a single feature store and a single project per environment (dev, staging, prod).

In this tutorial we will

1. Deploy a local feature store with a Parquet file offline store and Sqlite online store.

2. Build a training dataset using our time series features from our Parquet files.

3. Materialize feature values from the offline store into the online store.

4. Read the latest features from the online store for inference.

You can run this tutorial in Google Colab or run it on your localhost, following the guided steps below.

Run in Google Colab

Overview

In this tutorial, we use feature stores to generate training data and power online model inference for a ride-sharing driver satisfaction prediction model. Feast solves several common issues in this flow:

1. Training-serving skew and complex data joins: Feature values often exist across multiple tables. Joining these datasets can be complicated, slow, and error-prone.

   • Feast joins these tables with battle-tested logic that ensures point-in-time correctness so future feature values do not leak to models.

   • *Upcoming: Feast alerts users to offline / online skew with data quality monitoring.

2. Online feature availability: At inference time, models often need access to features that aren't readily available and need to be precomputed from other datasources.

   • Feast manages deployment to a variety of online stores (e.g. DynamoDB, Redis, Google Cloud Datastore) and ensures necessary features are consistently available and freshly computed at inference time.

3. Feature reusability and model versioning: Different teams within an organization are often unable to reuse features across projects, resulting in duplicate feature creation logic. Models have data dependencies that need to be versioned, for example when running A/B tests on model versions.

   • Feast enables discovery of and collaboration on previously used features and enables versioning of sets of features (via feature services).

   • Feast enables feature transformation so users can re-use transformation logic across online / offline usecases and across models.

Step 1: Install Feast

Install the Feast SDK and CLI using pip:

• In this tutorial, we focus on a local deployment. For a more in-depth guide on how to use Feast with GCP or AWS deployments, see Running Feast with GCP/AWS

pip install feast

Step 2: Create a feature repository

Bootstrap a new feature repository using feast init from the command line.

feast init feature_repo
cd feature_repo

Creating a new Feast repository in /home/Jovyan/feature_repo.

Let's take a look at the resulting demo repo itself. It breaks down into

• data/ contains raw demo parquet data

• example.py contains demo feature definitions

• feature_store.yaml contains a demo setup configuring where data sources are