GetInference AI nuggets - Dec 27

Code red at Google & 2023 Predictions

Author

Vincent Sider
December 26, 2022

Hello pioneers !  As the year 2022 comes to a close and we start to look ahead to 2023, people are starting to make some wild predictions about what will happen with Stable Diffusion (and other text2img models) and ChatGPT.

Spotlight

Some experts and media outlets are speculating that ChatGPT could potentially threaten Google's search dominance (link), causing the search giant to go into a state of "code red" panic. Apparently, Google is worried about the possibility of ChatGPT cannibalizing its ad revenues from search, so it'll be interesting to see how they respond (if at all). But hey, let's not get ahead of ourselves - we still have to see what happens with GPT-4 first!

Now, ChatGPT is already incredibly advanced, so I'm wondering what other capabilities GPT4 could potentially have that would make it such a significant improvement over GPT3. It's a larger data model so more accurate and human-like dialogue, but what else?

GPT3 has a few fundamental flaws that could be patched up in future versions. Any progress on any of these would be huge:

  1. no coherent theory of mind: GPT3 does not model minds at all, neither its own nor others.

  2. Hallucination: GPT3 does not know when it doesn't know. Instead it just makes up plausible sounding nonsense

  3. No real model of the external world: similar to 1), it doesn't really understand that the outside world exists at all

  4. Lacking knowledge due to limited training data: this will probably be solved with GPT4

  5. Poorly implemented guardrails that can either be broken easily (jailbreak) or lead to decreased functionality (AI refuses to participate in "plays")

Points 1 to 3 are limitations of transformers, they will still be in GPT-4, unless OpenAI is switching to something new, which seems doubtful. It would be possible to implement a separate routine which watches the output of a transformer for statistics or other facts about the world, then does some accuracy check. You wouldn't want this built into GPT-4, but it could be built into ChatGPT4.

As far as Stable Diffusion is concerned (and others txt2img models), It looks like some anti-AI art groups have been causing quite a stir lately, as they've been pressuring companies to ban any images generated by AI on their websites. In fact, they've even managed to cancel Unstable Diffusion's Kickstarter and Patreon page because of their distaste for AI art. These groups claim to be open and welcoming, but it seems they're not afraid to go to extreme lengths to shut down those who don't agree with their point of view. The AI community is understandably concerned, with some even calling out the GoFundMe to ban AI art as a scam and illegal. They argue that such a ban would not only impact AI art, but also things like fan art and parody. It seems like these artists might be shooting themselves in the foot with their actions. (link) (link)

NB: Your beloved AI curator has just uncovered the Star Wars cantina in a small city close to Shimonoseki, Japan. I can't believe it. A video of the exciting discovery will be published in the next newsletter, so stay tuned for all the nerdy fun. May the force be with you!

More below..

Code Red at Google

Tools

  • Replicate - Run open-source models with a cloud API. (link)

  • GPT-3+ HARO Journo Response Generator - A tool that uses GPT-3 to identify and respond to press requests from journalists looking for sources for a story. (link)

  • Penelope(Alpha) - A sophisticated AI writing assistant. (link)

  • SlackGPT - Zapier template to query GPT-3 via a Slack channel in real-time. (link)

  • DetectGPT - A Chrome extension to detect if a page contains AI-generated content. (link)

  • Paperade -AI-powered tool that generates commercial use cases and company ideas from over 100 million academic papers and research studies. (link)

  • Visual Hound (BETA) - Prototype your fashion design ideas with AI. (link)

  • MarbleFlows - AI-generated forms to convert more leads. (link)

  • Replai - Chrome extension to create meaningful Twitter replies with AI. (link)

  • Karlo - The first large scale open source DALL-E 2 replication. (link)

  • Anypod - AI search engines built for creators. Search through your favourite podcast. (link)

    Learn

    • The near future of AI is action-driven. Over the next few months we’re going to see increasingly surprising and useful applications rolling out. If you can think of a job that involves manipulating symbols on a computer: Action-driven AI is coming.(link)

    • How you can use your own artwork to train custom AI style models with Runway. (link)

    • How are students using AI?. (link)

    • A thread with companies using AI in amazing applications. (link)

      Build

      • Using Zapier to integrate a Slack channel to talk with ChatGPT.(Zap template)

        Alright folks, don't forget that I will be hosting a  limited space webinar early next year to guide you through the use of AI in the marketing funnel. I will walk you through each stage of the marketing funnel and demonstrate how AI can be utilized to improve your efforts, while also curating a selection of helpful tools along the way. Keep an eye out for more information on the webinar in the coming weeks and if you want to reserve your spot, please pre-book here now: