featurestores
Creates, updates, deletes, gets or lists a featurestores
resource.
Overview
Name | featurestores |
Type | Resource |
Id | google.aiplatform.featurestores |
Fields
The following fields are returned by SELECT
queries:
- get
- list
Successful response
Name | Datatype | Description |
---|---|---|
name | string | Output only. Name of the Featurestore. Format: projects/{project}/locations/{location}/featurestores/{featurestore} |
createTime | string (google-datetime) | Output only. Timestamp when this Featurestore was created. |
encryptionSpec | object | Optional. Customer-managed encryption key spec for data storage. If set, both of the online and offline data storage will be secured by this key. (id: GoogleCloudAiplatformV1EncryptionSpec) |
etag | string | Optional. Used to perform consistent read-modify-write updates. If not set, a blind "overwrite" update happens. |
labels | object | Optional. The labels with user-defined metadata to organize your Featurestore. Label keys and values can be no longer than 64 characters (Unicode codepoints), can only contain lowercase letters, numeric characters, underscores and dashes. International characters are allowed. See https://goo.gl/xmQnxf for more information on and examples of labels. No more than 64 user labels can be associated with one Featurestore(System labels are excluded)." System reserved label keys are prefixed with "aiplatform.googleapis.com/" and are immutable. |
onlineServingConfig | object | Optional. Config for online storage resources. The field should not co-exist with the field of OnlineStoreReplicationConfig . If both of it and OnlineStoreReplicationConfig are unset, the feature store will not have an online store and cannot be used for online serving. (id: GoogleCloudAiplatformV1FeaturestoreOnlineServingConfig) |
onlineStorageTtlDays | integer (int32) | Optional. TTL in days for feature values that will be stored in online serving storage. The Feature Store online storage periodically removes obsolete feature values older than online_storage_ttl_days since the feature generation time. Note that online_storage_ttl_days should be less than or equal to offline_storage_ttl_days for each EntityType under a featurestore. If not set, default to 4000 days |
satisfiesPzi | boolean | Output only. Reserved for future use. |
satisfiesPzs | boolean | Output only. Reserved for future use. |
state | string | Output only. State of the featurestore. |
updateTime | string (google-datetime) | Output only. Timestamp when this Featurestore was last updated. |
Successful response
Name | Datatype | Description |
---|---|---|
name | string | Output only. Name of the Featurestore. Format: projects/{project}/locations/{location}/featurestores/{featurestore} |
createTime | string (google-datetime) | Output only. Timestamp when this Featurestore was created. |
encryptionSpec | object | Optional. Customer-managed encryption key spec for data storage. If set, both of the online and offline data storage will be secured by this key. (id: GoogleCloudAiplatformV1EncryptionSpec) |
etag | string | Optional. Used to perform consistent read-modify-write updates. If not set, a blind "overwrite" update happens. |
labels | object | Optional. The labels with user-defined metadata to organize your Featurestore. Label keys and values can be no longer than 64 characters (Unicode codepoints), can only contain lowercase letters, numeric characters, underscores and dashes. International characters are allowed. See https://goo.gl/xmQnxf for more information on and examples of labels. No more than 64 user labels can be associated with one Featurestore(System labels are excluded)." System reserved label keys are prefixed with "aiplatform.googleapis.com/" and are immutable. |
onlineServingConfig | object | Optional. Config for online storage resources. The field should not co-exist with the field of OnlineStoreReplicationConfig . If both of it and OnlineStoreReplicationConfig are unset, the feature store will not have an online store and cannot be used for online serving. (id: GoogleCloudAiplatformV1FeaturestoreOnlineServingConfig) |
onlineStorageTtlDays | integer (int32) | Optional. TTL in days for feature values that will be stored in online serving storage. The Feature Store online storage periodically removes obsolete feature values older than online_storage_ttl_days since the feature generation time. Note that online_storage_ttl_days should be less than or equal to offline_storage_ttl_days for each EntityType under a featurestore. If not set, default to 4000 days |
satisfiesPzi | boolean | Output only. Reserved for future use. |
satisfiesPzs | boolean | Output only. Reserved for future use. |
state | string | Output only. State of the featurestore. |
updateTime | string (google-datetime) | Output only. Timestamp when this Featurestore was last updated. |
Methods
The following methods are available for this resource:
Name | Accessible by | Required Params | Optional Params | Description |
---|---|---|---|---|
get | select | projectsId , locationsId , featurestoresId | Gets details of a single Featurestore. | |
list | select | projectsId , locationsId | filter , pageSize , pageToken , orderBy , readMask | Lists Featurestores in a given project and location. |
create | insert | projectsId , locationsId | featurestoreId | Creates a new Featurestore in a given project and location. |
patch | update | projectsId , locationsId , featurestoresId | updateMask | Updates the parameters of a single Featurestore. |
delete | delete | projectsId , locationsId , featurestoresId | force | Deletes a single Featurestore. The Featurestore must not contain any EntityTypes or force must be set to true for the request to succeed. |
batch_read_feature_values | exec | projectsId , locationsId , featurestoresId | Batch reads Feature values from a Featurestore. This API enables batch reading Feature values, where each read instance in the batch may read Feature values of entities from one or more EntityTypes. Point-in-time correctness is guaranteed for Feature values of each read instance as of each instance's read timestamp. | |
search_features | exec | projectsId , locationsId | query , pageSize , pageToken | Searches Features matching a query in a given project. |
Parameters
Parameters can be passed in the WHERE
clause of a query. Check the Methods section to see which parameters are required or optional for each operation.
Name | Datatype | Description |
---|---|---|
featurestoresId | string | |
locationsId | string | |
projectsId | string | |
featurestoreId | string | |
filter | string | |
force | boolean | |
orderBy | string | |
pageSize | integer (int32) | |
pageToken | string | |
query | string | |
readMask | string (google-fieldmask) | |
updateMask | string (google-fieldmask) |
SELECT
examples
- get
- list
Gets details of a single Featurestore.
SELECT
name,
createTime,
encryptionSpec,
etag,
labels,
onlineServingConfig,
onlineStorageTtlDays,
satisfiesPzi,
satisfiesPzs,
state,
updateTime
FROM google.aiplatform.featurestores
WHERE projectsId = '{{ projectsId }}' -- required
AND locationsId = '{{ locationsId }}' -- required
AND featurestoresId = '{{ featurestoresId }}' -- required;
Lists Featurestores in a given project and location.
SELECT
name,
createTime,
encryptionSpec,
etag,
labels,
onlineServingConfig,
onlineStorageTtlDays,
satisfiesPzi,
satisfiesPzs,
state,
updateTime
FROM google.aiplatform.featurestores
WHERE projectsId = '{{ projectsId }}' -- required
AND locationsId = '{{ locationsId }}' -- required
AND filter = '{{ filter }}'
AND pageSize = '{{ pageSize }}'
AND pageToken = '{{ pageToken }}'
AND orderBy = '{{ orderBy }}'
AND readMask = '{{ readMask }}';
INSERT
examples
- create
- Manifest
Creates a new Featurestore in a given project and location.
INSERT INTO google.aiplatform.featurestores (
data__etag,
data__labels,
data__onlineServingConfig,
data__onlineStorageTtlDays,
data__encryptionSpec,
projectsId,
locationsId,
featurestoreId
)
SELECT
'{{ etag }}',
'{{ labels }}',
'{{ onlineServingConfig }}',
{{ onlineStorageTtlDays }},
'{{ encryptionSpec }}',
'{{ projectsId }}',
'{{ locationsId }}',
'{{ featurestoreId }}'
RETURNING
name,
done,
error,
metadata,
response
;
# Description fields are for documentation purposes
- name: featurestores
props:
- name: projectsId
value: string
description: Required parameter for the featurestores resource.
- name: locationsId
value: string
description: Required parameter for the featurestores resource.
- name: etag
value: string
description: >
Optional. Used to perform consistent read-modify-write updates. If not set, a blind "overwrite" update happens.
- name: labels
value: object
description: >
Optional. The labels with user-defined metadata to organize your Featurestore. Label keys and values can be no longer than 64 characters (Unicode codepoints), can only contain lowercase letters, numeric characters, underscores and dashes. International characters are allowed. See https://goo.gl/xmQnxf for more information on and examples of labels. No more than 64 user labels can be associated with one Featurestore(System labels are excluded)." System reserved label keys are prefixed with "aiplatform.googleapis.com/" and are immutable.
- name: onlineServingConfig
value: object
description: >
Optional. Config for online storage resources. The field should not co-exist with the field of `OnlineStoreReplicationConfig`. If both of it and OnlineStoreReplicationConfig are unset, the feature store will not have an online store and cannot be used for online serving.
- name: onlineStorageTtlDays
value: integer
description: >
Optional. TTL in days for feature values that will be stored in online serving storage. The Feature Store online storage periodically removes obsolete feature values older than `online_storage_ttl_days` since the feature generation time. Note that `online_storage_ttl_days` should be less than or equal to `offline_storage_ttl_days` for each EntityType under a featurestore. If not set, default to 4000 days
- name: encryptionSpec
value: object
description: >
Optional. Customer-managed encryption key spec for data storage. If set, both of the online and offline data storage will be secured by this key.
- name: featurestoreId
value: string
UPDATE
examples
- patch
Updates the parameters of a single Featurestore.
UPDATE google.aiplatform.featurestores
SET
data__etag = '{{ etag }}',
data__labels = '{{ labels }}',
data__onlineServingConfig = '{{ onlineServingConfig }}',
data__onlineStorageTtlDays = {{ onlineStorageTtlDays }},
data__encryptionSpec = '{{ encryptionSpec }}'
WHERE
projectsId = '{{ projectsId }}' --required
AND locationsId = '{{ locationsId }}' --required
AND featurestoresId = '{{ featurestoresId }}' --required
AND updateMask = '{{ updateMask}}'
RETURNING
name,
done,
error,
metadata,
response;
DELETE
examples
- delete
Deletes a single Featurestore. The Featurestore must not contain any EntityTypes or force
must be set to true for the request to succeed.
DELETE FROM google.aiplatform.featurestores
WHERE projectsId = '{{ projectsId }}' --required
AND locationsId = '{{ locationsId }}' --required
AND featurestoresId = '{{ featurestoresId }}' --required
AND force = '{{ force }}';
Lifecycle Methods
- batch_read_feature_values
- search_features
Batch reads Feature values from a Featurestore. This API enables batch reading Feature values, where each read instance in the batch may read Feature values of entities from one or more EntityTypes. Point-in-time correctness is guaranteed for Feature values of each read instance as of each instance's read timestamp.
EXEC google.aiplatform.featurestores.batch_read_feature_values
@projectsId='{{ projectsId }}' --required,
@locationsId='{{ locationsId }}' --required,
@featurestoresId='{{ featurestoresId }}' --required
@@json=
'{
"csvReadInstances": "{{ csvReadInstances }}",
"bigqueryReadInstances": "{{ bigqueryReadInstances }}",
"destination": "{{ destination }}",
"passThroughFields": "{{ passThroughFields }}",
"entityTypeSpecs": "{{ entityTypeSpecs }}",
"startTime": "{{ startTime }}"
}';
Searches Features matching a query in a given project.
EXEC google.aiplatform.featurestores.search_features
@projectsId='{{ projectsId }}' --required,
@locationsId='{{ locationsId }}' --required,
@query='{{ query }}',
@pageSize='{{ pageSize }}',
@pageToken='{{ pageToken }}';