
Explore LM Studio's interface to locate and download llms like llama two and mistral, compare model weights on Hugging Face Hub across mac, windows, and linux.
Load and interact with offline large language models in LM Studio. Use my models and adapters to chat, compare responses, and create new chats for different results.
Interact with vision models in LM Studio by uploading images, describing their contents, and generating image prompts with Dall-E 3.
Learn to use LM Studio as a RESTful backend API to send prompts or images from a mobile app and receive text or image descriptions from a local inference server.
Learn to use LM Studio as a backend API, run a local server, and send curl requests to localhost:1234, observing how system prompts affect the AI's rhymed replies.
Interact with the LM Studio local inference server using Python and localhost:1234. Learn to create a Python script and install the OpenAI library to run the example.
Learn to interact with the LM Studio model using Python and the OpenAI API version 0.28, install with pip, run example.py, and edit the rhyming output.
Troubleshoot OpenAI API versions when using LM Studio; compare scripts for OpenAI v0.28 vs v1.4.0, install latest OpenAI via pip, and check GitHub releases to resolve compatibility.
learn to run a vision script with python in lm studio, load a vision model, and describe images, as shown with penguins and a white heron, offline.
Open a private LLM server to the online world by using ngrok to forward localhost port 1234 to an online domain, enabling development access from any device (not for production).
Demonstrate monitoring online llm requests by using ngrok to expose the web interface, post to chat completion, inspect 200 responses, headers, and raw data, and compare models in LM Studio.
Learn to build an iPhone app that interfaces with a server-side LM via Ngrok, routing a chat completion workflow through a backend API and LM Studio.
Open Xcode and create an iOS app with a storyboard in Swift, then scaffold an AI manager interface to connect iPhone app to LM studio back end via Ngrok.
Design an iOS user interface in Xcode using the main storyboard, a prompt text field, a text view, and a send button with constraints.
Connect the user interface to the view controller by creating and wiring outlets for the UI text field, the send button, and the UI text area, and establishing their types.
Wire the three connections: text field input, the send button, and the text area. Then implement the IBAction to capture the prompt and prepare backend interaction.
Configure the AI manager interface to send user prompts to the LM Studio back end. Define API key, server base URL, and system and user messages to generate text asynchronously.
Create the network request by building the server URL for v1/chat/completion, guard the URL, set a post request with content type application/json, attach the JSON-serialized body, and handle failures.
Build and execute the network API call to the local private server (LM Studio) using a JSON body, handle errors, parse the response, and resume the data task.
Connect the view controller to AIManager to send a prompt with a system message to a private server and display the generated text in the text area.
Improve iOS UI by adding a large activity indicator in main storyboard, wiring it to the view controller, and updating the UI on the main thread during LM Studio responses.
Capture a photo on iOS, send it to the LM Studio vision model via the local server, and display the generated image description in the app.
Improve iOS apps by capturing a photo, encoding it as base64, and generating a description from a vision LLM hosted on LM Studio via a private server in Swift.
Prepare an iOS network call to Vision LLM by converting an image URL to data, encoding it in base64, and outlining the request body structure for a private server interaction.
Construct the LLM vision request body for LM Studio, setting the local model, building messages with role and content, and embedding a base64 image with token and stream options.
Learn how to send a network request to Vision LLM in LM Studio using a prepared payload to generate image descriptions, and verify the response with an example of penguins.
Learn to fetch a photo from the iPhone, encode its data in base64, and send it to the LM Studio API via the simulator, including saving the image to Photos.
Rename the send button to select photo, add a UI image view with constraints, and wire an outlet to display the chosen image in a new iOS photo selection UI.
Connects a select photo button to an image view by implementing an ibaction and wiring outlets. Sets up a photo picker with uiimagepickercontroller and delegates to open the photo library.
Learn to integrate the image picker: select an image from the gallery using UIImagePickerController, convert it to JPEG data, handle dismissal, and cancellation, and prepare for backend upload.
Modify iOS code to send image data from the image picker to a private server, replacing image URLs with base64 image data and display generated description in the text area.
Create a travel buddy iPhone app by configuring a travel-focused system message in the AI manager and connecting to a private LM Studio chat server.
Create a language learning iPhone app in Xcode using the AI manager to generate text with a private server chat, Lingua Chat prompts guiding French phrase practice and real-time translation.
Develop an online dating coaching app that analyzes chat screenshots, queries a private LLM for response suggestions, and helps users craft replies to secure a date.
Use the Vision framework to read text from screenshots by building a text recognition manager in Swift. Employ VNRecognizeTextRequest to extract the main dating chat text.
Learn to extract text from screenshots with a text recognition manager integrated with the image picker and vision manager, then send the extracted text to a private llm server.
Craft a system message to make the AI an online dating and relationship psychology expert. Develop editing code for a private LM server, including a dating menu and conversation extraction.
Send a request to a private LM server from an iOS app using a system message and I manager, then display the server reply in the UI with progress feedback.
Test and demonstrate a private LM server–driven dating coach inside an iOS app, validating UI changes, main-thread handling, text recognition, and real conversations to land a date.
Build the AI dating coach iOS app UI by adding a table view controller with dynamic prototype cells to show multiple conversation threads.
Configure a table view cell to show thread color and the conversation name. Set the row height to 44 pixels and add constraints.
Enhance the iOS table view with a header, a plus button, and a prototype cell featuring a disclosure accessory, while configuring constraints and colors to enable tapping into conversations.
Create the message and thread data models for the ai assisted dating coach iOS app, with a text or image message and a codable thread class for local storage.
Fix thread decodable conformance by ensuring messages are non-nil and codable, add coding keys for id, ribbon color, person name, and messages, and implement decode/encode logic.
Learn to create UI color convenience extensions to initialize from hex strings and encode colors back to hex, plus building a thread manager with mock data for save and retrieval.
Create a thread manager to handle multiple conversations by adding, saving, loading, and deleting threads, with a singleton shared instance and local storage for images and thread data.
Create and manage a thread manager singleton, store and retrieve an array of threads from user defaults using JSON encoding and decoding, and handle encoding and decoding errors.
Save and retrieve images to local storage by saving ui images as jpeg in the documents directory, using file URLs and paths, with do-catch error handling and path-based retrieval.
Learn to add and delete threads in a chat-like structure by updating a thread array, guarding against out-of-bounds indices, and saving changes to local storage.
Create the thread list view controller that drives the table view, wire it to the storyboard, and populate it with mock threads and a configurable thread cell.
Develop a table view driven thread list, handle row selection and deselection to load a thread and its details, add mock threads, and wire storyboard connections for the thread cell.
Tap the plus button to open an alert, enter the person’s name, and create a new thread with a color and unique id using the add new thread workflow.
learn to implement adding a new thread, display the new conversation in the list, refresh the table view, and apply a random ribbon color via the thread manager saving locally.
Learn to implement a thread manager in iOS development to save and retrieve conversations, populate threads on view load, and add new threads to the list.
Implement a swipe-to-delete for the thread list that removes a thread via the thread manager, saves changes locally, and updates the table view.
rename the view controller to thread details view controller, pass the selected thread from the list, and load messages into a scroll view with proper constraints.
Instantiate the thread details view controller from the storyboard, load the messages of the selected thread, and present or push it to display text and images.
Load and display text messages in a thread by iterating thread messages, creating labels, and laying them out in a scroll view with a dynamic y offset.
Load existing text messages and extend the view to display image messages by checking image paths, creating an image view with aspect fit, and updating the scroll view's content size.
Fix the nil text issue and extend the message view to support images by saving image paths with a generated uuid file name and displaying text and image together.
Test the thread image messaging feature in the simulator, adding messages with images and ensuring loading works while avoiding duplicates, and updating the thread via the thread manager.
Append new messages in the thread details view and update the thread via the thread manager to preserve history on app reload, while debugging the missing thread image.
Modify the thread message model to save only the image name (uuid) and load images from the documents directory, then display them in the thread details view controller.
Save live messages to the current thread by uploading a photo, displaying it in the conversation, and saving the image when it returns from the backend.
Welcome to "Advanced Language Model Studio Development," an immersive course designed to take you through the intricacies of working with OpenAI's Language Model Studio (LM Studio). This course provides an in-depth exploration of various aspects, ranging from fundamental setup and troubleshooting to the practical implementation of language and vision models in real-world applications. Throughout the journey, you'll gain hands-on experience with coding, server management, and app development, elevating your skills in harnessing the power of language models.
Course Structure:
Module 1: Introduction to LM Studio Setup and Troubleshooting (Lectures 001 - 005) In this introductory module, you'll get acquainted with the LM Studio environment. Learn how to set up the server, address common troubleshooting issues, and ensure compatibility between different API versions. Gain insights into the importance of using the correct OpenAI framework version and explore techniques to troubleshoot and resolve version-related challenges.
Module 2: Interacting with LM Studio: Text and Chat Models (Lectures 021 - 023) Delve into the practical aspects of working with text and chat models. Understand the nuances of scripting with OpenAI's API, and explore troubleshooting techniques for varying versions. Witness real-time interactions with the LM Studio backend, and grasp the steps involved in changing responses dynamically using Vim. Develop a comprehensive understanding of the differences between OpenAI framework versions.
Module 3: Transitioning from Local to Online: ENR and Server Accessibility (Lectures 0040 - 0041) Unlock the potential of making your LM Studio server accessible online. Explore the use of End-to-End Red (ENR) technology to transition from a local server to an online server. Learn the intricacies of forwarding domain names to local IP addresses and securing your online server. Witness a step-by-step guide to making your language model accessible from any device, opening up possibilities for broader applications.
Module 4: Monitoring and Managing Requests (Lectures 0041 - 0051) Gain proficiency in monitoring and managing requests made to language models using the Endr architecture and LM Studio interface. Learn to analyze request details, understand response times, and interchange between different language models seamlessly. Acquire insights into optimizing the performance of your language model by monitoring its responses in real-time.
Module 5: iPhone App Development Workflow (Lectures 0050 - 0064) Embark on an exciting journey into mobile app development using LM Studio. Understand the workflow of creating an iPhone app interface, handling network responses, and connecting the app to the LM Studio backend. Follow step-by-step instructions for creating an iOS user interface, connecting UI elements to code, and implementing network requests. Witness the integration of AIManager with LM Studio for interactive and dynamic app experiences.
Module 6: Vision LLM and Image Processing (Lectures 0070 - 0074) Explore the realm of Vision Large Language Models (LLM) and image processing. Learn how to identify objects in images using the Vision script with Python. Dive into the intricacies of preparing image data, creating network requests, and handling responses. Witness the magic of integrating Vision LLM with an iOS app to generate descriptions for images, opening up possibilities for image-based applications.
Module 7: Building Specialized Apps - Travel Recommendations and Language Learning (Lectures 0090 - 0091) Cap off your learning journey by applying your newfound skills to build specialized iPhone apps. Follow the creation of a travel recommendation app and a language learning companion using private language models. Understand how to tailor system messages, modify user interfaces, and implement dynamic responses for specific applications. Explore the endless possibilities of integrating language models into diverse app scenarios.
Conclusion: Once you'll complete the "Advanced Language Model Studio Development" course, you will have acquired a comprehensive skill set, ranging from server setup and troubleshooting to practical app development with LM Studio. This course is your gateway to harnessing the full potential of OpenAI's Language Model Studio in diverse real-world applications. Stay curious, keep coding, and continue pushing the boundaries of what's possible with language models!