Adding Machine Learning to our Designer's Toolbelt
During just four days, thanks to the wonderful people at Taller Estampa, we managed to collect a dataset, cluster its contents, run and modify pre-trained deep image generation networks, explore the latent space within, collect a ton of inspiration (see the link list below!) and finally launch our own speculative project using machine learning. While for now this is simply a collection of interesting findings during the seminar, in the next days I will gradually add more explanatory text to it to shine a light into the methodology used. More soon.
![](../../images/Bildschirmfoto-2021-12-01-um-11.18.02.jpeg)
![](../../images/Bildschirmfoto-2021-12-01-um-11.17.18.jpeg)
Image classification network grouping by similarities: vertical structures (left), graffitis (right)
![](../../images/Bildschirmfoto-2021-12-01-um-11.27.30.jpeg)
Different viewpoints but same relation, grouped in the dataset: a microscopic image of a bacteria culture (left image in the yellow circle), a satellite image of a Ukrainian river delta (right image).
![](../../images/PSI0-2.png)
![](../../images/PSI0-5.png)
![](../../images/PSI1-0.png)
![](../../images/PSI1-5.png)
![](../../images/PSI2.png)
![](../../images/PSI3.png)
Increasing the Truncation PSI value, decreasing the network's incentive to "play safe" (from top left to bottom right): 0,2 / 0,5 / 1 / 1,5 / 2 / 3
![](../../images/Bildschirmfoto-2021-12-01-um-13.39.39.jpeg)
![](../../images/Bildschirmfoto-2021-12-02-um-10.27.20.jpeg)
Finding myself in the latent space as the network tries to approximate data points with a given base image (left) and the my 'digital twin' in the network compared to the original portrait (right) after 1000 steps.
![](../../images/Bildschirmfoto-2021-12-01-um-14.02.44.jpeg)
![](../../images/Bildschirmfoto-2021-12-02-um-12.17.34.jpeg)
Messing around with my latent space pendant by changing the data point obviously responsible for the level of eye-openness (left) and finding myself in another dataset of historical images (right).
![](../../images/replicate-prediction-vdezxqqaabd4tktahmw73qo3ue.png)
![](../../images/replicate-prediction-iiasshsf6bezxd7v46ral4v7wq.png)
Trying abstract prompts for the image generation network: 'Heavenly Universe' (left), 'Squirrel of Doom' (right)
![](../../images/replicate-prediction-wvdj5d7zcfgkhbg6kbkfbvejoe-progress01.png)
![](../../images/replicate-prediction-wvdj5d7zcfgkhbg6kbkfbvejoe-progress02.png)
![](../../images/replicate-prediction-wvdj5d7zcfgkhbg6kbkfbvejoe-progress03.png)
![](../../images/replicate-prediction-wvdj5d7zcfgkhbg6kbkfbvejoe-progress04.png)
![](../../images/replicate-prediction-wvdj5d7zcfgkhbg6kbkfbvejoe-progress05.png)
![](../../images/replicate-prediction-wvdj5d7zcfgkhbg6kbkfbvejoe.png)
Turning my portrait into 'a bunny with a top hat' (within 250 steps).
Interesting Links
thiscatdoesnotexist.com 512×512 Pixel
imagenet2012: Know Your Data
Excavating AI
Exposing.ai
Quick, Draw!
Humans of A.I.
ADS-B Exchange - tracking 9691 aircraft
HOLLY HERNDON
Projectes | estampa
ImageNet
WordNet | A Lexical Database for English
Forma Fluens
Bloemenveiling, 2019 — ANNA RIDLER
VFRAME: 3D Printed Training Data
CUDA Zone | NVIDIA Developer
Runway | CREATE IMPOSSIBLE VIDEO
orpatashnik/styleclip – Text-Driven Manipulation of StyleGAN Imagery – Replicate
What Is AI Upscaling? | NVIDIA Blog
CAT-UXO - Ao 25 rtrtm submunition
Robust High-Resolution Video Matting with Temporal Guidance | Papers With Code
Deep Dream Generator
Font Map · An AI Experiment by IDEO
The Infinite Drum Machine by Manny Tan & Kyle McDonald - Experiments with Google
Bird Sounds by Manny Tan & Kyle McDonald - Experiments with Google
The Infinite Drum Machine
Visualizing Image Fields
Visualizing Image Fields
Colab Notebooks - Google Drive
Kopie von IAAC - 1 - Latent Space.ipynb - Colaboratory
StyleGAN3+CLIP.ipynb - Colaboratory
Explore – Replicate
orpatashnik/styleclip – Text-Driven Manipulation of StyleGAN Imagery – Replicate
bfirsh/vqgan-clip – Generates images with VQGAN and CLIP – Replicate
DALL·E: Creating Images from Text
NVlabs/ffhq-dataset: Flickr-Faces-HQ Dataset (FFHQ)
AlgorithmWatch
I'm Google
stephen ellcock - Google Search
The New York Public Library
Below the Surface - Archeologische vondsten Noord/Zuidlijn Amsterdam
Investigations ← Forensic Architecture
No Photo : Daniel Eatock
Benoit Broisat - Place Franz Liszt
THE PROJECT — Dear Data
'Datos en los bolsillos' | Domestika
Feltron: 2014 Annual Report
12:00 | Hayahisa TOMIYASU / 富安隼久
Latent History - Refik Anadol
Jake Elwes - The Zizi Show
Humans of AI — Philipp Schmitt
Do Androids Dream of Balenciaga SS29? | SSENSE
The Process of Seeing | estampa
Latent Spaces | estampa
IAAC - 1 - Latent Space.ipynb - Colaboratory
Kopie von IAAC - 1 - Latent Space (MET Faces).ipynb - Colaboratory
NVlabs/stylegan2-ada-pytorch: StyleGAN2-ADA - Official PyTorch implementation
stylegan2-ada-pytorch / pretrained
https://dadabots.com
Kopie von WaveNet.ipynb - Colaboratory
Magenta
Magenta Studio - Ableton Live Plugin
Kopie von D3Net-MSS.ipynb - Colaboratory
Kopie von Song Spleeter Colab - Colaboratory
SG2-ADA-PyTorch.ipynb - Colaboratory
dvschultz/ml-art-colabs: A list of Machine Learning Art Colabs
amrzv/awesome-colab-notebooks: Collection of google colaboratory notebooks for fast and easy experiments
Kopie von IAAC_3_Deep_Fake.ipynb - Colaboratory
Kopie von IAAC - 2 - UMAP.ipynb - Colaboratory