Paradigm Lost (CascadiaJS 2022 Talk Notes)
swyx 2022-09-01
Some show notes for my CascadiaJS talk for those who are looking for all the references and cut content. Final talk video:
The livestream was here https://twitter.com/fubits/status/1565673135940243457
Slides
https://docs.google.com/presentation/d/1bGi3KimlbuS0iLG5CCaUnIrzfOno4IbhaZdbI8oBrNQ/edit?usp=sharing
Reception
Intro
- shtick
- why are you not rich?
- this talk will change the way you think about your tech career
- What does it mean to be Full Stack?
Part 1: the standard paradigm: frontend/backend
- the stupid chart
- people happy https://2021.stateofjs.com/en-US/opinions
- but not paid https://survey.stackoverflow.co/2022/#salary-comp-total
- why not rich
- 2010 https://s2.studylib.net/store/data/017738962_1-def8fa4e10b06cfb07eb8f06875cdfed-768x994.png
- 2015 https://www.freecodecamp.org/news/our-1-600-hour-javascript-coding-curriculum-d4f151b782d2/
- 2017 https://www.freecodecamp.org/news/a-roadmap-to-becoming-a-web-developer-in-2017-b6ac3dddd0cf/
- 2022 https://www.freecodecamp.org/learn
- https://www.freecodecamp.org/news/freecodecamp-certifications/
- 2021 https://www.freecodecamp.org/news/building-a-data-science-curriculum-with-advanced-math-and-machine-learning/ - client-server, then three tier architecture: client-server-db
- LAMP stack, MEAN stack, MERN stack, JAM stack, FOFE/BOFE
- https://docs.aws.amazon.com/whitepapers/latest/serverless-multi-tier-architectures-api-gateway-lambda/three-tier-architecture-overview.html
- https://managementmania.com/en/three-tier-architecture
- maybe in modern paradigm, it is client-server-db-devops
Part 2: reality
- name your fave apps
- Motivational questions
- how do you build this https://hacker-recommended-books.vercel.app/category/0/all-time/page/2/2
- arxiv sanity
- search engine
- shazam https://news.ycombinator.com/item?id=32520593
- all the app types
- talk about the feature progress path
- blog -> features
- …
- AB test
- app -> features
- blog -> features
transition
4 departures:
3: The Local First App
- here is the standard paradigm
- PWA
- the WASM app: figma
- client-serverless-server
- client-server-offline-first
- https://github.com/jlongster/absurd-sql
- https://techcrunch.com/2022/08/04/rill-wants-to-rethink-bi-dashboards-with-embedded-database-and-instant-ux/
- https://stopa.io/post/296
- appsync https://medium.com/capgemini-norway/destroying-backends-with-amplify-appsync-graphql-api-5521c0e62a4c
- https://www.inkandswitch.com/local-first/
- https://riffle.systems/essays/prelude/
- client-edge-serverless-server
- deno
- examples
4: The Long Running Jobs
- queues
- schedulers
- fails all the time
- temporal pitch: https://www.swyx.io/temporal-miami
- this is a job:
5: Data Engineering Iceberg
- https://benn.substack.com/p/the-data-os yc data
- data blind spot
- https://twitter.com/swyx/status/1528906372917604352/photo/1
- python > js https://www.hntrends.com/2022/june.html?compare=Python&compare=TypeScript&compare=golang&compare=JavaScript&compare=Ruby&compare=Rust&compare=Java&compare=C%2B%2B&compare=C&compare=kotlin
- https://survey.stackoverflow.co/2022/#salary-comp-total
- Analytical usecase
- ETL
- ELT
- ELT+reverseETL https://medium.com/memory-leak/reverse-etl-a-primer-4e6694dcc7fb
- EtLT?
- ML:
- Explore, Label, Optimize
- Cleaning + Modeling + Training + Predicting + Deployment + Monitoring
- https://www.jcchouinard.com/machine-learning/ breakdown of DE, DA, MLE
- Exciting: Computer Vision, Self Driving, NLP, Deep Learning, Ethics
- Boring: Recommendation (Embeddings), Classification/NLP, Search & Ranking, Anomaly Detection, A/B Testing, Spam/Fraud Risk
- Operational usage
- V = f(d)
- feedback
- consistency
- live
- 2000: amazon a store for every customer https://www.youtube.com/watch?v=F9c1Y7hgGwE
- 2010: google-yahoo
- 2016: netflix https://twitter.com/TrungTPhan/status/1445768114109435923
- 2020: tiktok-google https://www.inc.com/jason-aten/tiktok-just-ended-googles-15-year-rein-as-worlds-most-popular-web-domain.html
6: Software 3.0
- https://thealgorithmicbridge.substack.com/p/stable-diffusion-is-the-most-important
- x https://medium.com/nerd-for-tech/prompt-engineering-the-career-of-future-2fb93f90f117
- capabilities (Markov models, Large Language Models)
- how large is large https://miro.medium.com/max/565/1*9pt5d4D7aGJqUqpra1tMzg.png
- translation https://towardsdatascience.com/software-3-0-how-prompting-will-change-the-rules-of-the-game-a982fbfe1e0
- generating SQL https://blog.seekwell.io/gpt3
- explaining jokes https://twitter.com/karpathy/status/1511359920804876298/photo/1
- Coding:
- copilot
- https://storage.googleapis.com/deepmind-media/AlphaCode/competition_level_code_generation_with_alphacode.pdf
- alpha go, alphafold
- Poetry, Emojis, Lists: https://blog.andrewcantino.com/blog/2021/04/21/prompt-engineering-tips-and-tricks/#a-few-more-examples
- filling in text: https://generative.ink/posts/methods-of-prompt-programming/#by-demonstration-n-shot
- image filling in
- text to image
- generative adversarial models https://machinelearningmastery.com/what-are-generative-adversarial-networks-gans/
- llama https://pub.towardsai.net/i-spent-15-in-dall-e-2-credits-creating-this-ai-image-and-heres-what-i-learned-52f352912025
- medieval wifi https://twitter.com/benjamin_hilton/status/1519417377720524800
- https://www.craiyon.com/
- https://twitter.com/weirddalle/status/1554080896797622273
- https://twitter.com/weirddalle/status/1553782316832800768
- https://twitter.com/weirddalle/status/1557723658462035969
- https://twitter.com/weirddalle/status/1551584953045258240
- https://twitter.com/weirddalle/status/1554125991307612160
- https://twitter.com/timsoret/status/1560339610588282880
- https://twitter.com/maccaw/status/1561716215760011264
- https://twitter.com/JIYUKENKYU_jp/status/1554758475368243200
- https://twitter.com/fabianstelzer/status/1561019187451011074
- image to image https://old.reddit.com/r/StableDiffusion/comments/wy7oa5/img2img_is_just_unreal_im_stunned/
- video to video
- tricking humans https://www.theguardian.com/technology/2022/jul/23/google-fires-software-engineer-who-claims-ai-chatbot-is-sentient
- fooling humans https://maraoz.com/2020/07/18/openai-gpt3/
- art contest https://storage.googleapis.com/deepmind-media/AlphaCode/competition_level_code_generation_with_alphacode.pdf
- helping you sleep https://anchor.fm/deepdreams
- business ideas https://ideasai.com/
- racoon heist https://twitter.com/simonw/status/1555626060384911360
- not picking up humans https://www.aiweirdness.com/gpt-3-tries-pickup-lines/
- optimizing titles https://minimaxir.com/2022/08/gpt3-blog-title-optimizer/
- this will be a job https://promptbase.com/
- there’s a book https://generative.ink/posts/methods-of-prompt-programming/
end
So. what does it mean to be full stack?
- PWAMVCCRUDETL