Skip to content

Error when uploading dataframe to a Feature Group #1550

@Lukas0203

Description

@Lukas0203

Hello,

Im trying to upload a dataframe with 1012 rows to a feature group but only 160 rows get uploaded.

Thats the python code:

logger.info("Uploading 'ranking' Feature Group to Hopsworks.")
rank_fg = feature_store.create_ranking_feature_group(
    fs,
    df=ranking_df,
    parents=[articles_fg, customers_fg, trans_fg],
    online_enabled=False
)
logger.info("✅ Uploaded 'ranking' Feature Group to Hopsworks!!")

create_ranking_feature_group function:

def create_ranking_feature_group(
    fs, df: pd.DataFrame, parents: list, online_enabled: bool = True
):
    rank_fg = fs.get_or_create_feature_group(
        name="ranking",
        version=1,
        description="Derived feature group for ranking",
        primary_key=["customer_id", "article_id"],
        parents=parents,
        online_enabled=online_enabled,
    )
    print(df.shape)
    rank_fg.insert(df, wait=True)


    for desc in constants.ranking_feature_descriptions:
        rank_fg.update_feature_description(desc["name"], desc["description"])

    return rank_fg

Thats the console log on the python script:
2025-01-20 20:10:19.165 | INFO | main::1 - Uploading 'ranking' Feature Group to Hopsworks.
(1012, 15)
Uploading Dataframe: 100.00% |██████████| Rows 1012/1012 | Elapsed Time: 00:01 | Remaining Time: 00:00
2025-01-20 20:10:34.599 | INFO | main::8 - ✅ Uploaded 'ranking' Feature Group to Hopsworks!!

Thats the console log on hopsworks:

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions