The application takes in user input through photos, audio files, previous chats, and personality traits and then creates a digital model of the deceased. The images are then used to create a realistic 3D model, while the audio files are converted to a voice clone that can speak like the deceased. The personality traits and chat history are used to generate personalized text conversations.
User input elements are explained below:
Audio Sample: Conversations that Echo the Past; To ensure a truly immersive experience, we have focused on converting the provided audio files into voice clone models. By integrating sophisticated speech synthesis techniques, we aim to replicate the deceased individual's unique vocal patterns, intonations, and nuances. This enables the AI to engage in conversations with the user, speaking with a voice that closely resembles that of their loved one.
Conversation information: Nurturing Meaningful Dialogue; Including personality traits and chat history, adds depth and authenticity to the AI-generated conversations. Our project aims to understand the individual's unique traits by incorporating natural language processing algorithms and sentiment analysis. This understanding enables the AI system to generate personalized responses and dialogue that align with the loved one's distinctive character, fostering a more meaningful and intimate interaction.
Chat history - The user will export chat history as a .txt file from any messaging platform like WhatsApp.
Personality traits: Users are prompted to choose personality traits from a pre-defined exhaustive list. Users are given the flexibility to input and customize any quirks or personality traits according to their preferences.
Photos: Realistic Videos from Photos; At the core of ReLive lies the ability to transform static photos into dynamic, lifelike videos. Leveraging cutting-edge computer vision techniques and 3D modeling, we meticulously create a digital model of the deceased from the provided photographs. This digital representation captures the true essence and appearance of the individual, immersing users in a visually authentic experience.