• The Bright Journey with AI
  • Posts
  • DeepMind's New Architecture | Open Source Models Close the Gap | OpenAI SearchGPT | Serverless Fine-Tuning from Microsoft

DeepMind's New Architecture | Open Source Models Close the Gap | OpenAI SearchGPT | Serverless Fine-Tuning from Microsoft

The Bright Journey with AI

📆 July 30th 2024📆 

Open source continues to charge forward with more innovations coming out of DeepMind & OpenAI.

  • Phi-3 gets serverless fine tuning from Microsoft. A good sign of better competition among the main contenders

  • Months after initial rumours, OpenAI announces SearchGPT to challenge Google - watch this space for more

  • DeepMind announce a new autoencoder architecture which vastly increases the interpretability of models. Great win for model steering and removal of bias

  • Open source models drastically close the gap on the main commercial labs

  • As always, too much to put in headlines. Check out the Other News Rollup section for a quickfire review of the top stories in AI.

Dive in for all the details!

🆘 Quick Tips 🆘 

I had a reader reach out recently asking if the quick tip on ChatGPT’s image capture was actually real. She then asked me if it could build a shopping list from what’s in the fridge?

I expected you could but I had to test it out to see just how far it could get. Took some specific instructions but it did a pretty good job for 10 minutes trying.

I want you to assume the role of a personal shopping assistant. Your goal is to keep my fridge stocked with items as they get used. To achieve this I will provide you with two images. The first image is of my fridge fully stocked. The second image will be taken just before I leave for the shop. 

When you receive the first image I want you to do the following:
1. List all the items that are present in the fridge
2. Remember this list carefully and exactly

When you receive the second image I want you to do the following:
1. Recall the list of items from the fully stocked fridge
2. List all the items that are now present in the fridge 
3. Compare the two lists and give me a concise shopping list of what is missing so I can get them from the store

Please check your work by reviewing the first list and image again if you need to. I do not want to know what items remain in the fridge, just what is missing. Do not give any suggestions beyond what is missing from the fridge. Do you understand?

These are simple ideas to show you just how accessible and easy to use AI tools are. They also show the power that is there right now. Whether you’re an individual with an idea or a business looking to get AI Ready I’d love to have a chat and see how I can help you unlock AI’s potential.

Get in touch today for a free 30 minute discovery call 

💫Help Support my Work💫

I really enjoy researching and writing about AI & appreciate your support. If you enjoy this content please use any of the options below to help

📰 News 📰 

Microsoft Launches Serverless Fine-Tuning for AI

Microsoft has introduced serverless fine-tuning for its Phi-3 small language model, allowing developers to adapt the model without managing servers. Phi-3, a 3 billion parameter model, offers affordable performance for enterprise applications. The new serverless option simplifies AI development, enabling quick access to fine-tuning capabilities. This move positions Microsoft competitively against OpenAI and other AI providers, as it aims to attract developers with flexible pricing and enhanced functionalities. Educational institutions like Khan Academy are already leveraging this technology for improved AI experiences.

Read More At: VentureBeat

OpenAI Launches SearchGPT to Compete with Google

OpenAI has unveiled SearchGPT, a prototype search engine utilizing generative AI to enhance user experience and streamline information retrieval. This new tool aims to challenge Google's dominance by providing conversational answers and relevant links, leveraging partnerships with publishers for data access. While Microsoft has already ventured into AI search with Bing, OpenAI's approach may reduce inaccuracies through retrieval augmented generation. As OpenAI seeks new revenue streams amidst rising operational costs, SearchGPT represents a strategic move to capture a share of the lucrative search market.

Read More At: Wired

DeepMind's Breakthrough in LLM Interpretability

DeepMind introduces JumpReLU, a new sparse autoencoder architecture that enhances the interpretability of large language models (LLMs). This innovative approach allows researchers to better understand LLM activations by breaking them down into manageable components. JumpReLU improves upon traditional methods by dynamically selecting thresholds for neuron activation, leading to superior reconstruction fidelity and efficiency. This advancement not only aids in interpreting LLM behaviour but also opens avenues for steering model outputs and mitigating issues like bias and toxicity. The research highlights the potential of sparse autoencoders in enhancing AI transparency and control.

Read More At: VentureBeat

Open-Source AI Models Disrupt Industry Leaders

Recent releases of Llama 3.1 by Meta and Mistral Large 2 have marked a significant shift in the AI landscape, challenging proprietary models. These open-source advancements promise democratization of AI technology, enabling smaller companies and developers to access sophisticated tools without high costs. However, this shift raises ethical concerns and necessitates new strategies for businesses to differentiate themselves. As the global community navigates this transformative period, collaboration and responsible development will be crucial to harnessing the potential of open-source AI while mitigating associated risks. The future of AI is becoming more open and participatory.

Read More At: VentureBeat

🔨 AI Powered Tools 🔨 

  • PimEyes - Face recognition search engine and reverse image search tool. It operates in the cybersecurity and privacy protection industry, allowing users to find images of themselves or others across the internet. AI-powered facial recognition technology enhances its accuracy and efficiency, making it stand out by providing detailed search results and potential online image tracking capabilities.

  • Modern Realty - Real estate platform designed to streamline property transactions and management. It operates within the real estate industry, offering tools for property listing, client management, and transaction processing. The use of AI helps automate various tasks, including property valuations, personalized property recommendations, and predictive market analysis, making real estate operations more efficient and user-friendly.

  • GPT Excel - AI-powered tool designed to generate and understand complex Excel, Google Sheets, and Airtable formulas. It serves professionals in various industries by streamlining spreadsheet processes. The platform's AI capabilities enable users to create automated scripts, SQL queries, and regular expressions, significantly enhancing productivity and accuracy in data handling and analysis tasks.

🗞️ Other News Rollup 🗞️ 

AI in Sales - Sales teams are increasingly adopting AI, resulting in improved revenue growth and productivity, according to Salesforce's latest report.

AI Traffic Solutions - Google's AI project optimizes traffic lights to reduce emissions and improve traffic flow in cities worldwide.

China's AI Breakthrough - Open source software is accelerating AI development in China, positioning the country for potential leadership in the field.

Weather Forecasting AI - Google's NeuralGCM model enhances weather forecasting speed and accuracy using machine learning techniques.

Democratic Freedom Coalition - Sam Altman calls for a US-led coalition to ensure AI supports democracy, not authoritarianism.

Gymnastics - The International Gymnastics Federation introduces AI for judging, enhancing accuracy but still relying on human oversight.

New Jersey AI Ambitions - New Jersey proposes $500 million in tax credits to attract AI companies, aiming to become a leading AI innovation centre.

AI Costs Rising - AI training costs are skyrocketing, prompting discussions on quantum computing as a potential solution for sustainability.

Grok Data Concerns - Grok chatbot's default data collection may violate EU law, raising privacy concerns for X users.

🎶 Prompts 🎶 

Prompts used to generate some of this issues images. Unless otherwise stated all images are using Dall-E and ChatGPT Plus.

Generate a wide banner style image that shows a humanoid AI searching through a haystack for a needle. The haystack should have a green computer code texture to it with the AI holding a magnifying glass over it while it searches
Generate a wide banner style image of a humanoid AI translating it's language so a human can understand. The scene should be set in a computer lab with the AI having human like features and an expression of calm and patience as it explains to the human. The human should look delighted that it can now understand
Generate a wide banner style image of two race cars blasting along an urban downtown scene. The leading car should be noticeably more expensive with the contender more modest. The image should depict the less expensive car making gains on the leader. Set the scene at night and lit by city lights. 

Thank You for Subscribing

Reply

or to participate.