Adding Machine Learning to our Designer's Toolbelt
During just four days, thanks to the wonderful people at Taller Estampa, we managed to collect a dataset, cluster its contents, run and modify pre-trained deep image generation networks, explore the latent space within, collect a ton of inspiration (see the link list below!) and finally launch our own speculative project using machine learning. While for now this is simply a collection of interesting findings during the seminar, in the next days I will gradually add more explanatory text to it to shine a light into the methodology used. More soon.


Image classification network grouping by similarities: vertical structures (left), graffitis (right)

Different viewpoints but same relation, grouped in the dataset: a microscopic image of a bacteria culture (left image in the yellow circle), a satellite image of a Ukrainian river delta (right image).






Increasing the Truncation PSI value, decreasing the network's incentive to "play safe" (from top left to bottom right): 0,2 / 0,5 / 1 / 1,5 / 2 / 3


Finding myself in the latent space as the network tries to approximate data points with a given base image (left) and the my 'digital twin' in the network compared to the original portrait (right) after 1000 steps.


Messing around with my latent space pendant by changing the data point obviously responsible for the level of eye-openness (left) and finding myself in another dataset of historical images (right).


Trying abstract prompts for the image generation network: 'Heavenly Universe' (left), 'Squirrel of Doom' (right)






Turning my portrait into 'a bunny with a top hat' (within 250 steps).
Interesting Links
          thiscatdoesnotexist.com 512×512 Pixel
          imagenet2012: Know Your Data
          Excavating AI
          Exposing.ai
          Quick, Draw!
          Humans of A.I.
          ADS-B Exchange - tracking 9691 aircraft
          HOLLY HERNDON
          Projectes | estampa
          ImageNet
          WordNet | A Lexical Database for English
          Forma Fluens
          Bloemenveiling, 2019 — ANNA RIDLER
          VFRAME: 3D Printed Training Data
          CUDA Zone | NVIDIA Developer
          Runway | CREATE IMPOSSIBLE VIDEO
          orpatashnik/styleclip – Text-Driven Manipulation of StyleGAN Imagery – Replicate
          What Is AI Upscaling? | NVIDIA Blog
          CAT-UXO - Ao 25 rtrtm submunition
          Robust High-Resolution Video Matting with Temporal Guidance | Papers With Code
          Deep Dream Generator
          Font Map · An AI Experiment by IDEO
          The Infinite Drum Machine by Manny Tan & Kyle McDonald - Experiments with Google
          Bird Sounds by Manny Tan & Kyle McDonald - Experiments with Google
          The Infinite Drum Machine
          Visualizing Image Fields
          Visualizing Image Fields
          Colab Notebooks - Google Drive
          Kopie von IAAC - 1 - Latent Space.ipynb - Colaboratory
          StyleGAN3+CLIP.ipynb - Colaboratory
          Explore – Replicate
          orpatashnik/styleclip – Text-Driven Manipulation of StyleGAN Imagery – Replicate
          
          bfirsh/vqgan-clip – Generates images with VQGAN and CLIP – Replicate
          DALL·E: Creating Images from Text
          NVlabs/ffhq-dataset: Flickr-Faces-HQ Dataset (FFHQ)
          AlgorithmWatch
          I'm Google
          stephen ellcock - Google Search
          The New York Public Library
          Below the Surface - Archeologische vondsten Noord/Zuidlijn Amsterdam
          Investigations ← Forensic Architecture
          
          No Photo : Daniel Eatock
          Benoit Broisat - Place Franz Liszt
          THE PROJECT — Dear Data
          'Datos en los bolsillos' | Domestika
          Feltron: 2014 Annual Report
          
          12:00 | Hayahisa TOMIYASU / 富安隼久
          
          Latent History - Refik Anadol
          Jake Elwes - The Zizi Show
          Humans of AI — Philipp Schmitt
          Do Androids Dream of Balenciaga SS29? | SSENSE
          The Process of Seeing | estampa
          Latent Spaces | estampa
          IAAC - 1 - Latent Space.ipynb - Colaboratory
          Kopie von IAAC - 1 - Latent Space (MET Faces).ipynb - Colaboratory
          NVlabs/stylegan2-ada-pytorch: StyleGAN2-ADA - Official PyTorch implementation
          stylegan2-ada-pytorch / pretrained
          https://dadabots.com
          
          Kopie von WaveNet.ipynb - Colaboratory
          Magenta
          Magenta Studio - Ableton Live Plugin
          Kopie von D3Net-MSS.ipynb - Colaboratory
          Kopie von Song Spleeter Colab - Colaboratory
          
          SG2-ADA-PyTorch.ipynb - Colaboratory
          dvschultz/ml-art-colabs: A list of Machine Learning Art Colabs
          amrzv/awesome-colab-notebooks: Collection of google colaboratory notebooks for fast and easy experiments
          Kopie von IAAC_3_Deep_Fake.ipynb - Colaboratory
          Kopie von IAAC - 2 - UMAP.ipynb - Colaboratory