i
Day 0 :: 6.1.2025 :: AE550106 DDH ()


Day 0 :: 6.1.2025 :: AE550106

Today we will tell You what this Kollisionen seminar should be about, what technologies we will use and where do we will, ideally, get...

Introduction

Introduction of main concepts (avatarization, generative AI) introduction of technologies (language models, Loras, retrieval-augmented generation) & tools (Flowise, text-webui) we will use.

Definitions

Generative KI

Generative künstliche Intelligenz (KI) widmet sich der Erstellung neuer, oft unvorhergesehener Daten oder Inhalte, die das Ergebnis des Lernens aus bestehenden Daten sind. Diese Modelle 'verstehen' irgendwie die Struktur und Verteilung der Daten, auf denen sie trainiert wurden, und versuchen, neue Muster zu erstellen, die mit diesen erlernten Mustern übereinstimmen. Generative Modelle können für verschiedene Zwecke verwendet werden, wie zum Beispiel die Erstellung von Bildern, Texten, Tönen oder Videos und werden oft in Bereichen wie der künstlichen Inhaltsproduktion oder Sprachsynthese eingesetzt.

Neuronale Netze

Neuronale Netze im Kontext der KI sind keine echten Nervenzellen, sondern softwarebasierte Modelle, deren Architektur von der Art und Weise inspiriert ist, wie das menschliche Gehirn Informationen verarbeitet. Diese Modelle bestehen aus "Schichten" von Datenstrukturen, die "Neuronen" genannt werden. Die Neuronen sind miteinander verbunden und ihre Verbindungen haben ein bestimmtes "Gewicht". Im Lernprozess passt das System diese Gewichte - auch "Parameter" genannt - allmählich an, um den Fehler zwischen seiner Vorhersage und dem, was vorhergesagt werden soll, zu verringern.

model

A trained neural network is stored in a file. This file is called "a model". When You want to use it - either for inferencing or training or both - You need to load the model from the disk into memory.

Based on the amount of "parameters" (e.g. numbers which represent the synaptic weight) the model contains, the process of loading into memory shall be or shall not be succesful ;)

lora

Lora is like a small "adapter" model which You can train as an addition to Your main "big" model. Training of a Lora is much faster than fine-tuning of the big model itself.

With a properly trained Lora, You will give Your avatar a unique personality.

training & inferencing

In machine learning and AI, we speak about

"training" when the AI is learning from the data we provide it

"inferencing" when the AI is using its current "knowledge" to solve new problems (e.g. problems which maybe weren't in the training data at all)

Avatar (etymology)

 "descent of a Hindu deity to earth in an incarnate or tangible form," from Sanskrit avatarana "descent" (of a deity to the earth in incarnate form), from ava- "off, down" (from Proto-Indo-European root *au- (2) "off, away") + base of tarati "(he) crosses over" (from PIE root *tere- (2) "cross over, pass through, overcome").

The meaning "concrete embodiment of something abstract" is from 1815. In computer use, it seems to trace to the novel "Snowcrash" (1992) by Neal Stephenson.

(Idea) Avatarization

Within the "idealist" philosophical tradition, it is not necessarily the physical person but rather a "pure idea" (e.g. protection, justice, wisdom, friendship etc.) which is to be "avatarized".

'I'-Avatarization

"I"-Avatarization is the process whereby a living human H consciously creates, develops, fine tunes and optimizes (his|her) own generative AI avatar datasets & models.

That is, using datasets (mails, chat transcripts etc.) to create a generative AI copy of one's self (an "I-Avatar") which could provide information in situation when H (her|him)self is not alive anymore.

Cybrid

dall-e%203%3A%20%22provide%20a%20picture%20of%20cybrid%20of%20john%20keats%20speaking%20with%20Ummon%2C%20the%20oldest%20AI%20in%20the%20technocore.%20ummon%20does%20not%20have%20a%20form%20of%20human%2C%20it%20is%20a%20radiant%20monolith%22

dall-e 3: "provide a picture of cybrid of john keats speaking with Ummon, the oldest AI in the technocore. ummon does not have a form of human, it is a radiant monolith"

A cybrid is an entity resulting from the fusion of an AI consciousness with a human body. (Dan Simmons, Cantos Hyperion)

What You need to create the avatar

Raison d'etre / Idea

Name

Description

Text dataset

Voice recording

Face / Appearance

Technologies

Language Models:::Ollama:::Flowise:::Text-to-speech:::Unreal:::Metahuman:::Audio2Face

Language Models

amsel.udk.ai/llm

Ollama

Ollama

Flowise

flow.udk.ai

Text-to-speech

amsel.udk.ai/tts

Unreal

Unreal

Metahuman

Metahuman

Audio2Face

Audio2Face

0th Avatar

0th Avatar