FAQ

Don't see your question?

We encourage you to ask questions on GitHub. Even better, once you get an answer, add the answer to this FAQ via a pull request!

Getting started

Which programming language should I use to run Feast in a microservice architecture?

We recommend Python.

Do you have any examples of how Feast should be used?

The quickstart is the easiest way to learn about Feast. For more detailed tutorials, please check out the tutorials page.

Concepts

Do feature views have to include entities?

No, there are feature views without entities.

How does Feast handle model or feature versioning?

Feast expects that each version of a model corresponds to a different feature service.

Feature views once they are used by a feature service are intended to be immutable and not deleted (until a feature service is removed). In the future, feast plan and feast apply will throw errors if it sees this kind of behavior.

What is the difference between data sources and the offline store?

The data source itself defines the underlying data warehouse table in which the features are stored. The offline store interface defines the APIs required to make an arbitrary compute layer work for Feast (e.g. pulling features given a set of feature views from their sources, exporting the data set results to different formats). Please see data sources and offline store for more details.

Is it possible to have offline and online stores from different providers?

Yes, this is possible. For example, you can use BigQuery as an offline store and Redis as an online store.

Functionality

How do I run get_historical_features without providing an entity dataframe?

Feast does supports fetching historical features without passing an entity dataframe with the request.

• As of today, only postgres offline feature store is supported for entity dataframe less retrieval. Remaining offline stores would be gradually updated to support the entity df less retrieval. The stores would be selected based on priorities and user base/request.

• The retrieval is based on start_date and end_date parameters to the function. Here are some combinations supported.

  • Both params are given, Returns data during the given start to end timerange.

  • Only start_date param is given, Returns data from the start date to now time.

  • Only end_date param is given, Returns data during the end_date minus TTL time in feature view.

  • Both params are not given, Returns data during the TTL time in feature view to now time.

• When multiple features are requested from multiple feature-views it is required to have entity ids in both of them for JOIN so that

This is an area we're actively interested in contributions for. See GitHub issue

Does Feast provide security or access control?

Feast currently does not support any access control other than the access control required for the Provider's environment (for example, GCP and AWS permissions).

It is a good idea though to lock down the registry file so only the CI/CD pipeline can modify it. That way data scientists and other users cannot accidentally modify the registry and lose other team's data.

Does Feast support streaming sources?

Yes. In earlier versions of Feast, we used Feast Spark to manage ingestion from stream sources. In the current version of Feast, we support push based ingestion. Feast also defines a stream processor that allows a deeper integration with stream sources.

Does Feast support feature transformation?

There are several kinds of transformations:

• On demand transformations (See docs)

  • These transformations are Pandas transformations run on batch data when you call get_historical_features and at online serving time when you call `get_online_features.

  • Note that if you use push sources to ingest streaming features, these transformations will execute on the fly as well

• Batch transformations (WIP, see RFC)

  • These will include SQL + PySpark based transformations on batch data sources.

• Streaming transformations (RFC in progress)

Does Feast have a Web UI?

Yes. See documentation.

Does Feast support composite keys?

A feature view can be defined with multiple entities. Since each entity has a unique join_key, using multiple entities will achieve the effect of a composite key.

What are the performance/latency characteristics of Feast?

Feast is designed to work at scale and support low latency online serving. See our benchmark blog post for details.

Does Feast support embeddings and list features?

Yes. Specifically:

• Simple lists / dense embeddings:

  • BigQuery supports list types natively

  • Redshift does not support list types, so you'll need to serialize these features into strings (e.g. json or protocol buffers)

  • Feast's implementation of online stores serializes features into Feast protocol buffers and supports list types (see reference)

• Sparse embeddings (e.g. one hot encodings)

  • One way to do this efficiently is to have a protobuf or string representation of https://www.tensorflow.org/guide/sparse_tensor

Does Feast support X storage engine?

The list of supported offline and online stores can be found here and here, respectively. The roadmap indicates the stores for which we are planning to add support. Finally, our Provider abstraction is built to be extensible, so you can plug in your own implementations of offline and online stores. Please see more details about customizing Feast here.

Does Feast support using different clouds for offline vs online stores?

Yes. Using a GCP or AWS provider in feature_store.yaml primarily sets default offline / online stores and configures where the remote registry file can live. You can override the offline and online stores to be in different clouds if you wish.

What is the difference between a data source and an offline store?

The data source and the offline store are closely tied, but separate concepts. The offline store controls how feast talks to a data store for historical feature retrieval, and the data source points to specific table (or query) within a data store. Offline stores are infrastructure-level connectors to data stores like Snowflake.

Additional differences:

• Data sources may be specific to a project (e.g. feed ranking), but offline stores are agnostic and used across projects.

• A feast project may define several data sources that power different feature views, but a feast project has a single offline store.

• Feast users typically need to define data sources when using feast, but only need to use/configure existing offline stores without creating new ones.

How can I add a custom online store?

Please follow the instructions here.

Can the same storage engine be used for both the offline and online store?

Yes. For example, the Postgres connector can be used as both an offline and online store (as well as the registry).

Does Feast support S3 as a data source?

Yes. There are two ways to use S3 in Feast:

• Using Redshift as a data source via Spectrum (AWS tutorial), and then continuing with the Running Feast with Snowflake/GCP/AWS guide. See a presentation we did on this at our apply() meetup.

• Using the s3_endpoint_override in a FileSource data source. This endpoint is more suitable for quick proof of concepts that won't necessarily scale for production use cases.

Is Feast planning on supporting X functionality?

Please see the roadmap.

Project

How do I contribute to Feast?

For more details on contributing to the Feast community, see here and this here.

Feast 0.9 (legacy)

What is the difference between Feast 0.9 and Feast 0.10+?

Feast 0.10+ is much lighter weight and more extensible than Feast 0.9. It is designed to be simple to install and use. Please see this document for more details.

How do I migrate from Feast 0.9 to Feast 0.10+?

Please see this document. If you have any questions or suggestions, feel free to leave a comment on the document!

What are the plans for Feast Core, Feast Serving, and Feast Spark?

Feast Core and Feast Serving were both part of Feast Java. We plan to support Feast Serving. We will not support Feast Core; instead we will support our object store based registry. We will not support Feast Spark. For more details on what we plan on supporting, please see the roadmap.