Integration of a proprietary software application and a multimodal LLM for enhanced nutritional guidance

Abstract

In the realm of health and wellness, the integration of data-driven technology and artificial intelligence (AI) has opened up new possibilities for personalized and data-driven approaches. HN-Assistant, a software application designed to analyze an individual's nutritional state and provide tailored recommendations, offers a powerful tool for promoting healthy eating habits. The HN-Assistant can also analyze how good a food product is at covering the estimated nutrient requirements. However, when combined with the capabilities of advanced AI assistants based on LLMs, the potential for comprehensive and insightful nutritional guidance is taken to new heights. This paper describes an attempt at integrating the proprietary software application HN-Assistant with GPT-4o to empower final users to make better nutritional decisions. The application was built in R programming language using the Shiny package, and the interaction between HN-Assistant and GPT-4o is based on an API in Python.