Ki-Cook: clustering multimodal cooking representations through knowledge-infused learning.

ABSTRACT: Cross-modal recipe retrieval has gained prominence due to its ability to retrieve a text representation given an image representation and vice versa. Clustering these recipe representations based on similarity is essential to retrieve relevant information about unknown food images. Existing studies cluster similar recipe representations in the latent space based on class names. Due to inter-class similarity and intraclass variation, associating a recipe with a class name does not provide sufficient knowledge about recipes to determine similarity. However, recipe title, ingredients, and cooking actions provide detailed knowledge about recipes and are a better determinant of similar recipes. In this study, we utilized this additional knowledge of recipes, such as ingredients and recipe title

SUBMITTER: Venkataramanan R 

PROVIDER: S-EPMC10406211 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature