Practical GenAI Problems in the Context of Information Theory
Paul Gesiak, Director, Data Analytics Consulting at EPAM, gave a presentation at EPAM’s annual event — Learning Week 2023. Anywhere Club is now making the video* of Paul’s presentation available to registered members of the Club.
A brief description of Paul’s presentation:
We are witnessing the rapid evolution of Generative AI that is ongoing and will continue. Focusing on models such as GPT-4, Claude 2 and LLaMa2, Paul explores the main challenges of using these models, including data privacy, bias, and misinformation risks. Key unknowns in AI, like explainability and unpredictability of behavior, are also discussed. Practical applications are shown in model training, with entropy helping to prevent model collapse and improve algorithm efficiency. Further research to enhance the understanding and functionality of Generative AI models is clearly not a whim, but a necessity.