{"id":180412,"date":"2025-04-10T13:16:32","date_gmt":"2025-04-10T13:16:32","guid":{"rendered":"https:\/\/peraltafinancing.com\/apple-2\/run-deepseek-locally-on-mac-works-with-other-llms-too\/"},"modified":"2025-04-10T13:16:32","modified_gmt":"2025-04-10T13:16:32","slug":"run-deepseek-locally-on-mac-works-with-other-llms-too","status":"publish","type":"post","link":"https:\/\/fivemor.com\/?p=180412","title":{"rendered":"Run DeepSeek locally on Mac (works with other LLMs, too)"},"content":{"rendered":"


\n<\/p>\n

\n

ChatGPT, Google\u2019s Gemini and Apple Intelligence<\/a> are powerful, but they all share one major drawback \u2014 they need constant access to the internet to work. If you value privacy and want better performance, running a large language model like DeepSeek, Google\u2019s Gemma or Meta\u2019s Llama locally on your Mac is a great alternative.<\/p>\n

Think it sounds complicated? It\u2019s easier than you think. With the right tools, you can run DeepSeek or any other popular LLM locally on your Mac with minimal effort.<\/p>\n

Why run DeepSeek or other LLMs locally on your Mac?<\/h2>\n

Privacy and security are the biggest reasons for running an LLM locally. This ensures the model cannot share data with external servers, giving you complete control when working with private and sensitive information.<\/p>\n

It is also faster and cheaper to run AI models locally to avoid recurring API fees. Plus, by running an LLM locally, you can train it with proprietary data, tailoring its responses to better suit your needs. This approach will also save precious time in the long run if you intend to use DeepSeek or other LLMs for work purposes.<\/p>\n

If you are a developer, you might want to run LLMs locally and play around with them to see how they can help your work. With the necessary technical know-how, you can also use the available AI models to build agentic tools for your work.<\/p>\n

How to run LLMs like DeepSeek and Llama locally on your Mac<\/h3>\n

You might think that running LLMs locally requires access to a high-end Mac with plenty of RAM. But that\u2019s not the case. It is possible to run an LLM locally if you have an Apple silicon-powered Mac with at least 16GB of system memory. Even 8GB of memory works, but your system performance will be negatively affected.<\/p>\n

Note that LLMs are available in several variations and with different parameters. The higher the parameter, the more complex and smarter the LLM is. And this also means the AI model will need more space and resources to run. For example, Meta\u2019s Llama<\/a> is available in several variations, including one with a 70 billion parameter. But to run this model, you must use a Mac with more than 40GB of free storage and more than 48GB of system memory.<\/p>\n

Ideally, try running an LLM like DeepSeek with a 7 billion or 8 billion parameter. That should run smoothly locally on a Mac with 16GB of system memory. If you have access to a more powerful Mac, use any model that suits your requirements.<\/p>\n

It is important to download the right model, depending on your use case. Some LLMs are good at reasoning, while others are good at solving coding queries. Some will better work at STEM chats and tasks, while others will be good at multiturn conversations and long context coherence.<\/p>\n

LM Studio is the easiest way to run LLMs locally on your Mac<\/h3>\n
\"LM
LM Studio makes running LLMs on your Mac easy.
Screenshot: Rajesh Pandey\/CultOfMac<\/span><\/figcaption><\/figure>\n

If you want to run LLMs like DeepSeek and Llama locally on your Mac, LM Studio is the easiest way to get started. The software is free for personal use.<\/p>\n

Here\u2019s how to get started:<\/p>\n

    \n
  • Download and install LM Studio<\/a> on your Mac, then launch the application.<\/li>\n
  • If your primary goal is to run DeepSeek locally, complete the onboarding process and download the model. Otherwise, you can skip the onboarding step.<\/li>\n
  • You should see a search bar<\/strong> at the top in LM Studio, asking you to Select a model to load<\/strong>. Click on it and search for the LLM you want to download and install.<\/li>\n
  • Alternatively, go through the list of available LLMs by clicking the Settings<\/strong> cog in the bottom-right corner of LM Studio. From the window that opens, select the Model Search<\/strong> tab from the left. Alternatively, directly open this window using the Command + Shift + M keyboard shortcut.<\/li>\n
  • You will see all the AI models available for download listed here. The window on the right will provide some insight into a given model, providing a brief description and its token limit.<\/li>\n
  • \u00a0Select DeepSeek, Meta\u2019s Llama, Qwen, phi-4 or any of the other available LLMs. Then click the Download<\/strong> button on the bottom right<\/li>\n
  • Note: While you can download multiple LLMs, LM Studio can only load and run one model at a time.<\/li>\n<\/ul>\n

    Use your downloaded LLM<\/h3>\n
    \"LM
    Customize the context length and resource usage of the LLM before loading it.
    Screenshot: Rajesh Pandey\/CultOfMac<\/span><\/figcaption><\/figure>\n

    After your LLM download finishes, close LM Studio\u2019s Mission Control window. Then, click on the top search bar and load the recently downloaded LLM. When loading an AI model, LM Studio will let you configure its context length, CPU thread pool size and other key settings. You can leave these settings as they are if you are unsure what they do.<\/p>\n

    You can now ask questions or use the LLM however you like.<\/p>\n

    LM Studio allows you to have multiple separate chats with an LLM. To initiate a new conversation, click the + icon from the toolbar at the top<\/span>. This is a handy option if you are simultaneously using the LLM to work on multiple projects. You can also create folders and sort your chats in them.<\/p>\n

    How to keep it from using all your Mac\u2019s resources<\/h3>\n
    \"LM
    LM Studio can ensure the AI model does not eat up all your Mac\u2019s system resources.
    Screenshot: Rajesh Pandey\/CultOfMac<\/span><\/figcaption><\/figure>\n

    If you are worried about the AI model eating up all your Mac\u2019s system resources, bring up LM Studio\u2019s settings using the keyboard shortcut Command + ,<\/strong>. Then, ensure the Model loading guardrails<\/strong> setting is set to Strict. This should ensure the LLM will not overload your Mac.<\/p>\n

    You can see the resource usage by LM Studio and your downloaded LLM in the bottom toolbar. If the CPU or memory usage is too high, consider switching to an AI model with a lower parameter to reduce resource usage.<\/p>\n

    For the past few weeks, I\u2019ve been using LM Studio to run Llama and DeepSeek LLMs locally on my Mac, and I\u2019ve been impressed by the performance of my M1 Mac mini<\/a> with 16GB of RAM. It has handled the workload effortlessly. Yes, the LLMs run more smoothly on my M1 Pro MacBook Pro. And the performance should be even better on newer M2-, M3- or M4-equipped Macs with higher system memory.<\/p>\n

    Still, even if you own an older Apple silicon Mac, don\u2019t assume it can\u2019t run LLMs smoothly. You\u2019ll be surprised by its performance.<\/p>\n

    Make sure to delete any unwanted LLMs from your Mac to free up space. Otherwise, if you download a few of them to try out, you will run out of space in no time. <\/p>\n<\/p><\/div>\n