{"id":179495,"date":"2025-04-09T22:35:05","date_gmt":"2025-04-09T22:35:05","guid":{"rendered":"https:\/\/peraltafinancing.com\/analytics\/the-open-source-competition-to-o3-mini-and-o1\/"},"modified":"2025-04-09T22:35:05","modified_gmt":"2025-04-09T22:35:05","slug":"the-open-source-competition-to-o3-mini-and-o1","status":"publish","type":"post","link":"https:\/\/fivemor.com\/?p=179495","title":{"rendered":"The Open-source Competition to o3-mini and o1"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div id=\"article-start\">\n<p>In a significant development for the AI community, Agentica and Together AI have released an open-source AI coding model named DeepCoder-14B. Offering code generation capabilities on par with closed-source competitors like <a href=\"https:\/\/www.analyticsvidhya.com\/blog\/2025\/02\/openai-o3-mini\/\" target=\"_blank\" rel=\"noreferrer noopener\">OpenAI\u2019s o3-mini<\/a> and <a href=\"https:\/\/www.analyticsvidhya.com\/blog\/2024\/09\/openai-o1\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">o1<\/a>, DeepCoder-14B positions itself as a formidable open-source alternative to proprietary models. Moreover, this new model ensures full transparency and developer accessibility. In this article, we will explore the features, training, and benchmark scores of DeepCoder-14B and compare its real-world performance with that of o3-mini and o1.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-what-is-deepcoder-14b\">What is DeepCoder-14B?<\/h2>\n<p>DeepCoder-14B is an open-source AI code generation model featuring 14 billion parameters. Unlike proprietary alternatives, it offers complete transparency while matching the capabilities and performance of OpenAI\u2019s o3-mini and o1. DeepCoder-14B thus demonstrates that open-source AI coding models can compete with industry leaders without requiring massive computational resources. <\/p>\n<p>The model utilizes innovative training techniques such as Iterative Context Lengthening and Overlong Filtering, allowing it to reason across 64K context windows despite being trained only on 32K contexts. Beyond its impressive coding capabilities, DeepCoder-14B also demonstrates strong mathematical reasoning skills in standard benchmark tests.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-key-features-of-deepcoder-14b\">Key Features of DeepCoder-14B<\/h3>\n<p>DeepCoder-14B advances open-source AI coding models with capabilities rivaling proprietary alternatives.<\/p>\n<ul class=\"wp-block-list\">\n<li><b>Advanced Training Techniques<\/b><span style=\"font-weight: 400;\">: Uses Iterative Context Lengthening to handle 64K context. Implements DeepCoder-14B reinforcement learning with Overlong Filtering.<\/span><\/li>\n<li><b>High-Quality Dataset<\/b><span style=\"font-weight: 400;\">: Trained on 24K verified coding problems. Each problem has strict quality controls with 5+ test cases.<\/span><\/li>\n<li><b>Fully Open-Source<\/b><span style=\"font-weight: 400;\">: Provides complete transparency with all code and training data. Available on GitHub and Hugging Face.<\/span><\/li>\n<li><b>Resource-Efficient<\/b>: Supports various quantization methods for efficiency. Compatible with TensorRT and vLLM inference systems.<\/li>\n<\/ul>\n<h2 class=\"wp-block-heading\" id=\"h-deepcoder-14b-benchmark-performance\">DeepCoder-14B Benchmark Performance<\/h2>\n<p>Below we present a comprehensive comparison of DeepCoder-14B against leading open-source and proprietary code generation tools. These benchmarks evaluate performance across multiple dimensions of coding capability and cross-domain problem-solving.<\/p>\n<div class=\"table-responsive mb-3\">\n<table class=\"table table-hover table-bordered\">\n<thead\/>\n<tbody>\n<tr>\n<td><strong>Model<\/strong><\/td>\n<td><strong>LCB (8\/1\/24-2\/1\/25)<\/strong><\/td>\n<td><strong>Codeforces Rating<\/strong><\/td>\n<td><strong>Codeforces Percentile<\/strong><\/td>\n<td><strong>HumanEval+ Pass@1<\/strong><\/td>\n<td><strong>AIME 2024<\/strong><\/td>\n<\/tr>\n<tr>\n<td><strong>DeepCoder-14B-Preview (ours)<\/strong><\/td>\n<td>60.6<\/td>\n<td>1936<\/td>\n<td>95.3<\/td>\n<td>92.6<\/td>\n<td>73.8<\/td>\n<\/tr>\n<tr>\n<td><strong>DeepSeek-R1-Distill-Qwen-14B<\/strong><\/td>\n<td>53.0<\/td>\n<td>1791<\/td>\n<td>92.7<\/td>\n<td>92.0<\/td>\n<td>69.7<\/td>\n<\/tr>\n<tr>\n<td><strong>o1-2024-12-17 (Low)<\/strong><\/td>\n<td>59.5<\/td>\n<td>1991<\/td>\n<td>96.1<\/td>\n<td>90.8<\/td>\n<td>74.4<\/td>\n<\/tr>\n<tr>\n<td><strong>o3-Mini-2025-1-31 (Low)<\/strong><\/td>\n<td>60.9<\/td>\n<td>1918<\/td>\n<td>94.9<\/td>\n<td>92.6<\/td>\n<td>60.0<\/td>\n<\/tr>\n<tr>\n<td><strong>o1-Preview<\/strong><\/td>\n<td>42.7<\/td>\n<td>1658<\/td>\n<td>88.5<\/td>\n<td>89<\/td>\n<td>40.0<\/td>\n<\/tr>\n<tr>\n<td><strong>Deepseek-R1<\/strong><\/td>\n<td>62.8<\/td>\n<td>1948<\/td>\n<td>95.4<\/td>\n<td>92.6<\/td>\n<td>79.8<\/td>\n<\/tr>\n<tr>\n<td><strong>Llama-4-Behemoth<\/strong><\/td>\n<td>49.4<\/td>\n<td>\u2013<\/td>\n<td>\u2013<\/td>\n<td>\u2013<\/td>\n<td>\u2013<\/td>\n<\/tr>\n<tr>\n<td><strong>DeepCoder-1.5B-Preview<\/strong><\/td>\n<td>25.1<\/td>\n<td>963<\/td>\n<td>28.5<\/td>\n<td>73.0<\/td>\n<td>\u2013<\/td>\n<\/tr>\n<tr>\n<td><strong>Deepseek-R1-Distill-Qwen-1.5B<\/strong><\/td>\n<td>16.9<\/td>\n<td>615<\/td>\n<td>1.9<\/td>\n<td>58.3<\/td>\n<td>28.8<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>DeepCoder-14B shows remarkable performance across multiple benchmarks. It scores 60.6% on LiveCodeBench, nearly matching proprietary alternatives. The model achieves a 1936 Codeforces rating. Its HumanEval+ results are impressive. These achievements place it among top-tier models despite limited resources.<\/p>\n<p>The model excels beyond coding with 73.8% accuracy on AIME math problems. This demonstrates exceptional transfer learning capabilities. Our benchmarks validate our training methodology. They prove careful data curation works. Specialized fine-tuning techniques are effective. Open-source AI coding models can achieve state-of-the-art results with moderate size.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-behind-deepcoder-s-success-sandbox-environment-and-training-recipe\">Behind DeepCoder\u2019s Success: Sandbox Environment and Training Recipe<\/h2>\n<p>DeepCoder\u2019s remarkable performance stems from its innovative approach to code evaluation during training.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-innovative-code-execution-infrastructure\">Innovative Code Execution Infrastructure<\/h3>\n<p>At the heart of DeepCoder\u2019s impressive performance lies a sophisticated code execution infrastructure that enables accurate reward calculation during reinforcement learning. This system tackles one of the most challenging aspects of training code generation tools: reliably evaluating thousands of code samples against multiple test cases. Here\u2019s how DeepCoder\u2019s architecture and training helps address this issue.<\/p>\n<figure class=\"wp-block-image size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"872\" height=\"473\" src=\"https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp\" alt=\"DeepCoder-14B training and architecture\" class=\"wp-image-230577\" srcset=\"https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp 872w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10-300x163.webp 300w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10-768x417.webp 768w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10-150x81.webp 150w\" sizes=\"(max-width: 872px) 100vw, 872px\"\/><\/figure>\n<p>Le me explain this in detail.<\/p>\n<h4 class=\"wp-block-heading\" id=\"h-1-dual-sandbox-approach\">1. Dual Sandbox Approach<\/h4>\n<p>DeepCoder employs two complementary sandbox environments to ensure reliable code execution:<\/p>\n<ol class=\"wp-block-list\">\n<li><b>Together Code Interpreter<\/b><span style=\"font-weight: 400;\">: This production-ready environment provides exceptional speed and security at a remarkably economical price point of just 3\u00a2 per problem. The team scaled this solution to handle over 100 concurrent sandboxes, processing more than 1,000 executions per minute. This sandbox captures standard input\/output streams while maintaining strict isolation from host systems.<\/span><\/li>\n<li><b>Local Code Sandbox<\/b>: For maximum reproducibility, the team developed a guard-railed Python subprocess implementation that perfectly mirrors LiveCodeBench\u2019s evaluation methodology. This ensures that all reported results directly correspond to the industry-standard benchmarks.<\/li>\n<\/ol>\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"872\" height=\"473\" src=\"https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-11.webp\" alt=\"DeepCoder-14B dual sandbox system\" class=\"wp-image-230578\" srcset=\"https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-11.webp 872w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-11-300x163.webp 300w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-11-768x417.webp 768w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/Infographic-11-11-150x81.webp 150w\" sizes=\"auto, (max-width: 872px) 100vw, 872px\"\/><\/figure>\n<h4 class=\"wp-block-heading\" id=\"h-2-principled-reward-design\">2. Principled Reward Design<\/h4>\n<p>Rather than using partial rewards that could lead to \u201creward hacking,\u201d DeepCoder implements a sparse Outcome Reward Model with binary outcomes:<\/p>\n<ul class=\"wp-block-list\">\n<li><b>Success (1)<\/b><span style=\"font-weight: 400;\">: Code must pass all sampled test cases<\/span><\/li>\n<li><b>Failure (0)<\/b>: Code fails any test or violates formatting requirements<\/li>\n<\/ul>\n<p>For problems with extensive test suites, the system strategically samples the 15 most challenging tests, identified by input complexity.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-grpo-enhanced-training-algorithm\">GRPO+: Enhanced Training Algorithm<\/h3>\n<p>DeepCoder introduces the GRPO+ (Generalized Reward-Weighted Policy Optimization Plus) algorithm into its training. GRPO+ is a significant evolution of the GRPO algorithm that incorporates key insights from DAPO (Diffusion Actor-Policy Optimization) research.<\/p>\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"817\" height=\"428\" src=\"https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/1-2-1.webp\" alt=\"GRPO+: Enhanced Training Algorithm\" class=\"wp-image-230579\" srcset=\"https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/1-2-1.webp 817w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/1-2-1-300x157.webp 300w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/1-2-1-768x402.webp 768w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/1-2-1-150x79.webp 150w\" sizes=\"auto, (max-width: 817px) 100vw, 817px\"\/><figcaption class=\"wp-element-caption\">Source: <a href=\"https:\/\/github.com\/agentica-project\/rllm\" target=\"_blank\" rel=\"nofollow noopener\">Average training reward vs Training Steps<\/a><\/figcaption><\/figure>\n<h4 class=\"wp-block-heading\" id=\"h-key-algorithmic-innovations-in-grpo\">Key Algorithmic Innovations in GRPO+<\/h4>\n<p>The team made four critical modifications to enable stable training at scale:<\/p>\n<ol class=\"wp-block-list\">\n<li><b>Entropy Loss Elimination<\/b><span style=\"font-weight: 400;\">: By removing the entropy loss term that frequently caused training collapse, GRPO+ maintains consistent exploration throughout the training process.<\/span><\/li>\n<li><b>KL Loss Removal<\/b><span style=\"font-weight: 400;\">: Freeing the model from being constrained to the original SFT model\u2019s trust region improves both performance and training speed by eliminating reference policy calculations.<\/span><\/li>\n<li><b>Overlong Filtering<\/b><span style=\"font-weight: 400;\">: This technique prevents penalizing truncated sequences, preserving the model\u2019s long-context reasoning capabilities. Remarkably, this allowed DeepCoder to generalize to 64K contexts despite being trained only on 32K sequences.<\/span><\/li>\n<li><b>Clip High<\/b>: By adjusting the upper bound in the surrogate loss function, GRPO+ encourages more exploration while maintaining stable entropy levels throughout training.<\/li>\n<\/ol>\n<p>These algorithmic improvements work together to create DeepCoder\u2019s distinctive learning pattern: steadily increasing response lengths, stable reward curves, and consistent token-level entropy\u2014all contributing to its exceptional coding capabilities.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-smarter-training-scaling-context-and-reasoning-together\">Smarter Training: Scaling Context and Reasoning Together<\/h3>\n<p>Training large models is already a heavy lift, but training them to reason across long contexts is an even bigger challenge. Most models either compromise on the depth of reasoning or hit a wall when the context size increases.<\/p>\n<p>DeepCoder addresses this head-on with a two-pronged training approach:<\/p>\n<h4 class=\"wp-block-heading\" id=\"h-1-iterative-context-lengthening\">1. Iterative Context Lengthening<\/h4>\n<p>Instead of jumping to long contexts immediately, the model is trained in stages:<\/p>\n<ul class=\"wp-block-list\">\n<li>Starts at 16K tokens<\/li>\n<li>Scales up to 32K<\/li>\n<li>Evaluated at 64K \u2014 even though it was never trained on that length!<\/li>\n<\/ul>\n<p>This gradual scaling allows the model to learn how to \u201cthink in longer documents\u201d instead of simply memorizing token spans. The results speak for themselves:<\/p>\n<ul class=\"wp-block-list\">\n<li>16K context: 54% on LiveCodeBench<\/li>\n<li>32K context: 58%<\/li>\n<li>64K context: 60.6% (despite zero training at that length)<\/li>\n<\/ul>\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"776\" height=\"404\" src=\"https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/3-5.webp\" alt=\"DeepCoder-14B Iterative context lengthening\" class=\"wp-image-230580\" srcset=\"https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/3-5.webp 776w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/3-5-300x156.webp 300w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/3-5-768x400.webp 768w, https:\/\/cdn.analyticsvidhya.com\/wp-content\/uploads\/2025\/04\/3-5-150x78.webp 150w\" sizes=\"auto, (max-width: 776px) 100vw, 776px\"\/><\/figure>\n<h4 class=\"wp-block-heading\" id=\"h-2-overlong-filtering-inspired-by-dapo\">2. Overlong Filtering (Inspired by DAPO)<\/h4>\n<p>To avoid feeding the model noisy, excessively long samples that dilute learning, DeepCoder adopts overlong filtering, a technique inspired by DAPO. This filters out training samples that exceed optimal length and helps maintain clarity in what the model learns.<\/p>\n<p>Together, these strategies ensure that the model doesn\u2019t just grow \u2014 it grows smarter.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-data-curation-from-chaos-to-clean-verified-coding-problems\">Data Curation: From Chaos to Clean, Verified Coding Problems<\/h2>\n<p>Let\u2019s face it \u2013 coding datasets on the internet is a mess! Whether scraped from GitHub, online judges, or forums, they\u2019re often incomplete, buggy, or inconsistent. That becomes a problem for reinforcement learning (RL), which relies on verifiable, consistent reward signals.<\/p>\n<p>To solve this, the AgenticAI team built a custom data curation pipeline that focuses on:<\/p>\n<ul class=\"wp-block-list\">\n<li>Including only official solutions that pass all test cases<\/li>\n<li>Ensuring at least 5 high-quality unit tests per problem<\/li>\n<li>Deduplicating training and test sets to avoid leakage or evaluation inflation<\/li>\n<\/ul>\n<p>The code below shows the core validation logic used in their data processing pipeline. This function checks each problem against quality standards before allowing it into the dataset:<\/p>\n<pre class=\"wp-block-code\"><code># Simplified data processing workflow using custom data curation pipeline\ndef validate_problem(problem):\n    if problem.test_cases <\/code><\/pre>\n<p>The result is a clean, verifiable dataset of 24,000 coding problems \u2013 perfectly suited for RL fine-tuning. This careful filtering ensures that rewards during training actually reflect correctness, not chance or overfitting.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-deepcoder-14b-reinforcement-learning-at-scale-the-rllm-framework\">DeepCoder-14B Reinforcement Learning at Scale: The rLLM Framework<\/h2>\n<p>Evaluating code is different from evaluating text. You can\u2019t just compare token similarity \u2013 you need to run the code and test its output, ideally thousands of times across edge cases. That\u2019s where DeepCoder\u2019s open-source RL engine, rLLM comes in.<\/p>\n<p><strong>Here\u2019s what makes rLLM stand out:<\/strong><\/p>\n<ul class=\"wp-block-list\">\n<li><span style=\"font-weight: 400;\">Built on the verl framework (r<\/span><span style=\"font-weight: 400;\">educes end2end training times by up to 2x)<\/span><span style=\"font-weight: 400;\">, an efficient training engine designed for code<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Capable of running 1,000+ unit tests per minute<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Uses 100+ parallel sandboxes to evaluate submissions simultaneously<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Supports both:<\/span>\n<ul class=\"wp-block-list\">\n<li><span style=\"font-weight: 400;\">Together Code Interpreter (cheap, fast, $0.03\/problem)<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Local sandbox mirroring LiveCodeBench for reproducibility<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>This infrastructure isn\u2019t just about speed \u2014 it makes large-scale, verifiable RL training practical. No hand-waving, no approximations; real code, real tests, real results.<\/p>\n<p>Want to try it? Head to the repo: <a href=\"http:\/\/github.com\/agentica-project\/rllm\" target=\"_blank\" rel=\"nofollow noopener\">github.com\/agentica-project\/rllm<\/a><\/p>\n<h2 class=\"wp-block-heading\" id=\"h-getting-hands-on-with-deepcoder\">Getting Hands-on with DeepCoder<\/h2>\n<p>While DeepCoder\u2019s performance metrics are impressive, what makes this project truly valuable to the AI community is its accessibility and reproducibility. This section walks through the practical aspects of working with this innovative model, from initial setup to advanced training configurations.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-step-1-setting-up-your-environment\">Step 1: Setting Up Your Environment<\/h3>\n<p>DeepCoder\u2019s development team has optimized the codebase for Python 3.10, ensuring stability while leveraging modern language features. The installation process begins with creating a dedicated Conda environment:<\/p>\n<pre class=\"wp-block-code\"><code>conda create -n rllm python=3.10 -y\nconda activate rllm<\/code><\/pre>\n<p>After navigating to the rllm directory, you\u2019ll need to install both the verl reinforcement learning framework and the main package:<\/p>\n<pre class=\"wp-block-code\"><code>cd rllm\npip install -e .\/verl\npip install -e .<\/code><\/pre>\n<p>This installation pattern reflects modular architecture, with verl serving as the specialized DeepCoder-14B reinforcement learning engine that powers its impressive code generation capabilities.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-step-2-preparing-training-data\">Step 2: Preparing Training Data<\/h3>\n<p>One of DeepCoder\u2019s strengths lies in its meticulously curated dataset. The repository provides both the raw training data and preprocessing scripts to transform it into optimized formats for training.<\/p>\n<p>To begin working with this data:<\/p>\n<pre class=\"wp-block-code\"><code># First, download the curated datasets from GDrive\npython scripts\/data\/download_datasets.py\n# Then generate optimized parquet files for training\npython scripts\/data\/deepcoder_dataset.py  # For DeepCoder\n# or\npython scripts\/data\/deepscaler_dataset.py  # For DeepScaleR<\/code><\/pre>\n<p>These preprocessing steps implement the rigorous data quality controls mentioned earlier, ensuring that all code examples meet the strict requirements for DeepCoder-14B reinforcement learning.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-step-3-training-options-for-different-scales\">Step 3: Training Options for Different Scales<\/h3>\n<p>DeepCoder\u2019s flexible training architecture accommodates various computational resources, making it accessible to both individual researchers and larger teams with significant infrastructure.<\/p>\n<h4 class=\"wp-block-heading\" id=\"h-for-individual-researchers\">For Individual Researchers<\/h4>\n<p>Those with access to a single high-performance machine can begin training with:<\/p>\n<pre class=\"wp-block-code\"><code>export MODEL_PATH=\"deepseek-ai\/DeepSeek-R1-Distill-Qwen-1.5B\"<p>.\/scripts\/deepcoder\/train\/file.sh --model $MODEL_PATH<\/p><\/code><\/pre>\n<p>This single-node configuration provides an excellent entry point for experimenting with the framework or fine-tuning for specific domains.<\/p>\n<h4 class=\"wp-block-heading\" id=\"h-for-research-teams\">For Research Teams<\/h4>\n<p>Larger experiments benefit from DeepCoder\u2019s distributed training capabilities. The setup uses Ray for coordinating training across multiple machines:<\/p>\n<ol class=\"wp-block-list\">\n<li>The head node must initialize the Ray cluster:<\/li>\n<li>Worker nodes then connect to this coordinator:<\/li>\n<li>With the cluster ready, training can be launched:<\/li>\n<\/ol>\n<ol class=\"wp-block-list\">\n<li>The head node must initialize the Ray cluster:<br \/><code>export VLLM_ATTENTION_BACKEND=XFORMERS<br \/>ray start --head<\/code><\/li>\n<li>Worker nodes then connect to this coordinator:<br \/><code>export VLLM_ATTENTION_BACKEND=XFORMERS<br \/>ray start --address=[HEAD_NODE_ADDRESS]<\/code><\/li>\n<li>With the cluster ready, training can be launched:<br \/><code>.\/scripts\/deepcoder\/train\/file.sh --model [CHECKPOINT_PATH]<\/code><\/li>\n<\/ol>\n<p>This scalable approach was instrumental in achieving DeepCoder\u2019s breakthrough performance, allowing the team to effectively train on longer context lengths and larger datasets.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-step-4-rigorous-evaluation-framework\">Step 4: Rigorous Evaluation Framework<\/h3>\n<p>DeepCoder\u2019s performance claims are backed by a comprehensive evaluation framework that automatically runs multiple instances of vLLM to test the model\u2019s capabilities:<\/p>\n<pre class=\"wp-block-code\"><code>.\/scripts\/eval\/eval_model.sh --model [CHECKPOINT_PATH] \\\n                           --datasets [DATASET1] [DATASET2] \\\n                           --output-dir [OUTPUT_DIR] \\\n                           --n [N_PASSES] \\\n                           --tp [TENSOR_PARALLEL_SIZE] \\\n                           --max-length [MAX_CONTEXT_LENGTH]<\/code><\/pre>\n<p>This evaluation approach mirrors the LiveCodeBench methodology, ensuring that reported metrics accurately reflect real-world performance on challenging coding tasks.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-deepcoder-14b-hands-on-performance\">DeepCoder-14B Hands-on Performance<\/h2>\n<p>In this section, we explore DeepCoder-14B\u2019s capability to explain fundamental programming concepts in a clear and beginner-friendly way.<\/p>\n<p><strong>Task: Explaining a programming concept<\/strong><\/p>\n<p>Let\u2019s use DeepCoder-14B to explain how a hash table works and see if it can generate a Python example for it.<\/p>\n<p><strong>Code:<\/strong><\/p>\n<pre class=\"wp-block-code\"><code>response = llm.create_chat_completion(\n    messages = [\n        {\n            \"role\": \"user\",\n            \"content\": \"Explain how a hash table works with an example in Python.\"\n        }\n    ]\n)\nprint(response['choices'][0]['message']['content'])<\/code><\/pre>\n<p>print(response[\u2018choices\u2019][0][\u2018message\u2019][\u2018content\u2019])<\/p>\n<p><strong>Review:<\/strong><\/p>\n<p>DeepCoder-14B provided an impressively thoughtful and step-by-step conceptual breakdown of how hash tables function. Here\u2019s what stood out:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>Personalized Reasoning:<\/strong> The response felt almost like a beginner walking through the concept out loud, which adds a relatable, educational flavor to the explanation.<\/li>\n<li><strong>Detailed Theory:<\/strong> It covered key ideas like hashing, collisions, chaining, open addressing, and their real-world implementation in Python via dictionaries.<\/li>\n<li><strong>Structured Approach:<\/strong> The model didn\u2019t jump into code immediately but instead laid out the logic and design\u2014outlining steps like creating the array, defining a hash function, and handling collisions.<\/li>\n<li><strong>Missing Code Block:<\/strong> Although it promised to demonstrate a simple hash table in Python, the code snippet wasn\u2019t included in this output. For a fully complete answer, you might prompt it to <em>\u201ccontinue with the Python code example.\u201d<\/em><\/li>\n<\/ul>\n<p><strong>Inference Performance Note:<\/strong> While the model output was conceptually strong, the latency was very high (~11 minutes total time), indicating that DeepCoder-14B may be best suited for non-realtime applications like content generation, tutoring, or documentation.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-deepcoder-14b-vs-o3-mini-amp-o1-performance-comparison\">DeepCoder-14B vs o3-mini &amp; o1: Performance Comparison<\/h2>\n<p>In this section, we\u2019ll compare how DeepCoder-14B performs against OpenAI\u2019s o1 and 03-mini on two common programming tasks \u2013 code generation and bug fixing. We\u2019ll give the same 2 tasks to DeepCoder-14B, o3-mini (simulated with Phi-2), and o1 (simulated with LLaMA-2 7B) and see how the models\u2019 size and design impact code quality, explanation depth, and reasoning ability. From generating a simple function to identifying logic errors in recursive code, this comparison will give us a clearer picture of when bigger models really shine, and when smaller ones hold their own.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-task-1-code-generation-tools-comparison-deepcoder-vs-o3-mini-phi-2\">Task 1: Code Generation Tools Comparison \u2013 DeepCoder vs o3-mini (Phi-2)<\/h3>\n<p>Let\u2019s use DeepCoder-14B to generate a Python function that finds all prime numbers between 1 and 100, and compare its response with that of o3-mini.<\/p>\n<p><strong>DeepCoder-14B Code:<\/strong><\/p>\n<pre class=\"wp-block-code\"><code>response = llm.create_chat_completion(\n    messages = [\n        {\n            \"role\": \"user\",\n            \"content\": \"Write a Python function to find prime numbers between 1 and 100.\"\n        }\n    ]\n)\nprint(\"DeepCoder Output:\\n\", response['choices'][0]['message']['content'])<\/code><\/pre>\n<p><strong>Phi-2 (Simulating o3-mini) Code:<\/strong><\/p>\n<pre class=\"wp-block-code\"><code>from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline\ntokenizer = AutoTokenizer.from_pretrained(\"microsoft\/phi-2\")\nmodel = AutoModelForCausalLM.from_pretrained(\"microsoft\/phi-2\", device_map=\"auto\")\npipe = pipeline(\"text-generation\", model=model, tokenizer=tokenizer\nprompt = \"Write a Python function to find prime numbers between 1 and 100.\"\noutput = pipe(prompt, max_new_tokens=150)[0][\"generated_text\"]\nprint(\"Phi-2 Output:\\n\", output)<\/code><\/pre>\n<p><strong>Review:<\/strong><\/p>\n<p>DeepCoder-14B provides a deeply thoughtful, step-by-step breakdown of the logic behind finding prime numbers, mimicking how a beginner might reason through the problem. While insightful, it doesn\u2019t return actual code, which limits its usefulness for direct execution. In contrast, Phi-2 (o3-mini) delivers a clean, correct Python function without any explanation\u2014fast, efficient, and ready to run. DeepCoder is better for educational depth, whereas Phi-2 excels at practical coding speed and clarity.<\/p>\n<h3 class=\"wp-block-heading\" id=\"h-task-2-bug-fixing-and-reasoning-deepcoder-vs-o1-llama-2-7b\">Task 2: Bug Fixing and Reasoning \u2013 DeepCoder vs o1 (LLaMA-2 7B)<\/h3>\n<p>Now let\u2019s challenge DeepCoder-14B with a classic debugging task. We\u2019ll feed it a buggy recursive factorial function and ask it to fix the code and explain what went wrong. We\u2019ll then give the same task to OpenAI\u2019s o1 model (simulated by LLaMA-27B) and compare their responses.<\/p>\n<p><strong>Buggy Code:<\/strong><\/p>\n<pre class=\"wp-block-code\"><code>buggy_code = \"\"\"\ndef factorial(n):\n    if n == 0:\n        return 0\n    else:\n        return n * factorial(n-1)\n\"\"\"<\/code><\/pre>\n<p>\u201c\u201d\u201d<\/p>\n<p><strong>DeepCoder-14B:<\/strong><\/p>\n<pre class=\"wp-block-code\"><code>response = llm.create_chat_completion(\n    messages = [\n        {\n            \"role\": \"user\",\n            \"content\": f\"This code has a bug. Fix it and explain the correction:\\n{buggy_code}\"\n        }\n    ]\n)\nprint(\"DeepCoder Output:\\n\", response['choices'][0]['message']['content'])<\/code><\/pre>\n<p><strong>LLaMA-2 7B (simulating o1):<\/strong><\/p>\n<pre class=\"wp-block-code\"><code>from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline\ntokenizer = AutoTokenizer.from_pretrained(\"meta-llama\/Llama-2-7b-chat-hf\")\nmodel = AutoModelForCausalLM.from_pretrained(\"meta-llama\/Llama-2-7b-chat-hf\", device_map=\"auto\")\npipe = pipeline(\"text-generation\", model=model, tokenizer=tokenizer)\nprompt = \"This code has a bug. Fix it and explain the correction:\\n\" + buggy_code\noutput = pipe(prompt, max_new_tokens=200)[0][\"generated_text\"]\nprint(\"LLaMA-2 Output:\\n\", output)<\/code><\/pre>\n<p><strong>Review:<\/strong><\/p>\n<p>In this task, both DeepCoder-14B and o1 (LLaMA-2 7B) correctly identified the bug in the factorial function\u2014recognizing that the base case should return 1 instead of 0. DeepCoder-14B demonstrated strong reasoning by walking through the logic and highlighting how the incorrect base case leads to wrong results, particularly for n=1.<\/p>\n<p>However, its output suffered from a critical flaw: a repetitive loop of \u201cWait, no,\u201d which detracted from readability and made the response feel unstable. In contrast, o1 provided a concise, clean, and correct response, typically including both the fixed code and a brief explanation. While it lacked DeepCoder\u2019s depth of reasoning, o1\u2019s reliability and clarity made it more suitable for practical use, especially in deployment or educational contexts.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-future-developments-of-deepcoder-14b\">Future Developments of DeepCoder-14B<\/h2>\n<p>While current results focus on coding, the team plans to:<\/p>\n<ul class=\"wp-block-list\">\n<li>Extend the context window to 128K through dynamic NTK scaling.<\/li>\n<li>Develop multimodal reasoning capabilities.<\/li>\n<li>Create specialized variants for security auditing and legacy code modernization.<\/li>\n<\/ul>\n<p>This release marks a significant step toward democratizing advanced AI coding tools, providing researchers and developers with:<\/p>\n<ul class=\"wp-block-list\">\n<li>A complete training recipe matching proprietary model performance.<\/li>\n<li>Infrastructure for verifiable RL at scale.<\/li>\n<li>Baseline for future open-source advancements in program synthesis.<\/li>\n<\/ul>\n<p>The model\u2019s MIT license ensures unrestricted commercial and research use, fostering innovation across the AI ecosystem. With its combination of competitive performance and full transparency, DeepCoder-14B establishes a new standard for open-source AI coding models development.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-deepcoder-14b-access-and-usage\">DeepCoder-14B: Access and Usage<\/h2>\n<p>Everything about DeepCoder is built around transparency and community:<\/p>\n<p>This makes it a great resource for:<\/p>\n<ul class=\"wp-block-list\">\n<li>Researchers exploring RL fine-tuning<\/li>\n<li>Hackers and developers building custom coding agents<\/li>\n<li>Educators demonstrating how real-world AI coding systems are built and tested<\/li>\n<\/ul>\n<h2 class=\"wp-block-heading\" id=\"h-conclusion\">Conclusion<\/h2>\n<p>In an era dominated by closed walls and black-box models, DeepCoder-14B is a breath of fresh air. It shows that open-source AI coding models can scale, compete, and innovate \u2013 without hiding behind APIs or paywalls. From context scaling to math generalization, from verified datasets to high-speed sandboxes, everything about DeepCoder feels thoughtful, intentional, and community-first.<\/p>\n<p>Developers looking to enhance their coding workflow can start using DeepCoder immediately. The model\u2019s impressive performance on competition-level coding tasks makes it suitable for a wide range of applications, from automated code completion to algorithmic problem-solving. If you\u2019re building the future of AI-assisted development, DeepCoder-14B isn\u2019t just worth trying \u2013 it might become your new baseline.<\/p>\n<h2 class=\"wp-block-heading\" id=\"h-frequently-asked-questions\">Frequently Asked Questions<\/h2>\n<div class=\"schema-faq wp-block-yoast-faq-block\">\n<div class=\"schema-faq-section\" id=\"faq-question-1744218386636\"><strong class=\"schema-faq-question\">Q1. Why is DeepCoder-14B significant for the open-source community?<\/strong> <\/p>\n<p class=\"schema-faq-answer\">A. DeepCoder-14B challenges o3-mini model capabilities by delivering comparable coding performance (60.6% Pass@1 on LiveCodeBench) while being fully open-source. It provides full access to weights, datasets, and training frameworks, enabling developers to audit, adapt, and deploy the model without restrictive licenses.<\/p>\n<\/p><\/div>\n<div class=\"schema-faq-section\" id=\"faq-question-1744218396456\"><strong class=\"schema-faq-question\">Q2. How does DeepCoder-14B achieve efficiency with fewer parameters?<\/strong> <\/p>\n<p class=\"schema-faq-answer\">A. The model uses innovative training strategies like Iterative Context Lengthening, scaling from 16K to 32K tokens during training while generalizing to 64K contexts. Combined with Overlong Filtering to remove noisy data and GRPO+\u2014a refined RL algorithm\u2014it optimizes reasoning without parameter bloat, ensuring resource efficiency which can be seen through o3-mini vs DeepCoder-14B efficiency graph.<\/p>\n<\/p><\/div>\n<div class=\"schema-faq-section\" id=\"faq-question-1744218408364\"><strong class=\"schema-faq-question\">Q3. What benchmarks demonstrate its capabilities?<\/strong> <\/p>\n<p class=\"schema-faq-answer\">A. DeepCoder-14B scores 1936 on Codeforces (top 5% of human competitors) and 73.8% on AIME math problems, showing cross-domain reasoning. It matches DeepCoder-14B vs o3-mini accuracy despite using half the parameters, proving smaller models can rival larger proprietary counterparts through optimized training.<\/p>\n<\/p><\/div>\n<div class=\"schema-faq-section\" id=\"faq-question-1744218418052\"><strong class=\"schema-faq-question\">Q4. How does its open ecosystem benefit developers?<\/strong> <\/p>\n<p class=\"schema-faq-answer\">A. The model\u2019s MIT-licensed codebase, Hugging Face deployment, and reproducible rLLM training framework let developers customize it for niche tasks (e.g., legacy code modernization) or integrate it into IDEs. Transparent benchmarks and sandbox environments ensure reliable testing, unlike closed models with opaque evaluation.<\/p>\n<\/p><\/div>\n<div class=\"schema-faq-section\" id=\"faq-question-1744218430566\"><strong class=\"schema-faq-question\">Q5. Can it handle complex, real-world coding tasks?<\/strong> <\/p>\n<p class=\"schema-faq-answer\">A. Yes. Its dual sandbox system (cloud-based and local) validates code against rigorous test cases, and its 64K context support enables analysis of lengthy codebases. Developers report success in automating bug fixes, test generation, and algorithmic problem-solving at competition levels.<\/p>\n<\/p><\/div>\n<div class=\"schema-faq-section\" id=\"faq-question-1744218445803\"><strong class=\"schema-faq-question\">Q6. What makes its dataset unique?<\/strong> <\/p>\n<p class=\"schema-faq-answer\">A. The 24K-problem dataset enforces \u22655 verified test cases per problem and strict train\/test splits to prevent leakage. This curation ensures clean RL rewards, reducing overfitting risks common in scraped datasets.<\/p>\n<\/p><\/div>\n<\/p><\/div>\n<div class=\"border-top py-3 author-info my-4\">\n<div class=\"author-card d-flex align-items-center\">\n<div class=\"flex-shrink-0 overflow-hidden\">\n                                    <a href=\"https:\/\/www.analyticsvidhya.com\/blog\/author\/riyab20021618492\/\" class=\"text-decoration-none active-avatar\"><br \/>\n                                                                       <img decoding=\"async\" src=\"https:\/\/av-eks-lekhak.s3.amazonaws.com\/media\/lekhak-profile-images\/converted_image_5X1DGT2.webp\" width=\"48\" height=\"48\" alt=\"Riya Bansal.\" loading=\"lazy\" class=\"rounded-circle\"\/><\/p>\n<p>                                <\/a>\n                                <\/div>\n<\/p><\/div>\n<p>Gen AI Intern at Analytics Vidhya\u00a0<br \/>Department of Computer Science, Vellore Institute of Technology, Vellore, India\u00a0<\/p>\n<p>I am currently working as a Gen AI Intern at Analytics Vidhya, where I contribute to innovative AI-driven solutions that empower businesses to leverage data effectively. As a final-year Computer Science student at Vellore Institute of Technology, I bring a solid foundation in software development, data analytics, and machine learning to my role.\u00a0<\/p>\n<p>Feel free to connect with me at <a href=\"https:\/\/www.analyticsvidhya.com\/cdn-cgi\/l\/email-protection\" class=\"__cf_email__\" data-cfemail=\"76041f0f175814171805171a361718171a0f021f1505001f121e0f175815191b\">[email\u00a0protected]<\/a>\u00a0<\/p>\n<\/p><\/div>\n<\/p><\/div>\n<p><h4 class=\"fs-24 text-dark\">Login to continue reading and enjoy expert-curated content.<\/h4>\n<p>                        <button class=\"btn btn-primary mx-auto d-table\" data-bs-toggle=\"modal\" data-bs-target=\"#loginModal\" id=\"readMoreBtn\">Keep Reading for Free<\/button>\n                    <\/p>\n\n","protected":false},"excerpt":{"rendered":"<p>In a significant development for the AI community, Agentica and Together AI have released an open-source AI coding model named DeepCoder-14B. Offering code generation capabilities on par with closed-source competitors like OpenAI\u2019s o3-mini and o1, DeepCoder-14B positions itself as a formidable open-source alternative to proprietary models. Moreover, this new model ensures full transparency and developer [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":179496,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12033],"tags":[5308,34230,31230],"dealstore":[],"offerexpiration":[],"class_list":["post-179495","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-analytics","tag-competition","tag-o3mini","tag-opensource"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The Open-source Competition to o3-mini and o1 - Som2ny Network<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/fivemor.com\/?p=179495\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Open-source Competition to o3-mini and o1 - Som2ny Network\" \/>\n<meta property=\"og:description\" content=\"In a significant development for the AI community, Agentica and Together AI have released an open-source AI coding model named DeepCoder-14B. Offering code generation capabilities on par with closed-source competitors like OpenAI\u2019s o3-mini and o1, DeepCoder-14B positions itself as a formidable open-source alternative to proprietary models. Moreover, this new model ensures full transparency and developer [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/fivemor.com\/?p=179495\" \/>\n<meta property=\"og:site_name\" content=\"Som2ny Network\" \/>\n<meta property=\"article:published_time\" content=\"2025-04-09T22:35:05+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"872\" \/>\n\t<meta property=\"og:image:height\" content=\"473\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"17 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/fivemor.com\/?p=179495#article\",\"isPartOf\":{\"@id\":\"https:\/\/fivemor.com\/?p=179495\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\/\/fivemor.com\/#\/schema\/person\/b85e3c3dc0e1daea076524dc8810c371\"},\"headline\":\"The Open-source Competition to o3-mini and o1\",\"datePublished\":\"2025-04-09T22:35:05+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/fivemor.com\/?p=179495\"},\"wordCount\":3066,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/fivemor.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/fivemor.com\/?p=179495#primaryimage\"},\"thumbnailUrl\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp\",\"keywords\":[\"Competition\",\"o3mini\",\"OpenSource\"],\"articleSection\":[\"Analytics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/fivemor.com\/?p=179495#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/fivemor.com\/?p=179495\",\"url\":\"https:\/\/fivemor.com\/?p=179495\",\"name\":\"The Open-source Competition to o3-mini and o1 - Som2ny Network\",\"isPartOf\":{\"@id\":\"https:\/\/fivemor.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/fivemor.com\/?p=179495#primaryimage\"},\"image\":{\"@id\":\"https:\/\/fivemor.com\/?p=179495#primaryimage\"},\"thumbnailUrl\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp\",\"datePublished\":\"2025-04-09T22:35:05+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/fivemor.com\/?p=179495#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/fivemor.com\/?p=179495\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/fivemor.com\/?p=179495#primaryimage\",\"url\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp\",\"contentUrl\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp\",\"width\":872,\"height\":473},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/fivemor.com\/?p=179495#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/fivemor.com\/?bp_activities=1\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Open-source Competition to o3-mini and o1\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/fivemor.com\/#website\",\"url\":\"https:\/\/fivemor.com\/\",\"name\":\"Som2ny Network\",\"description\":\"Daily Deals\",\"publisher\":{\"@id\":\"https:\/\/fivemor.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/fivemor.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/fivemor.com\/#organization\",\"name\":\"Som2ny Network\",\"url\":\"https:\/\/fivemor.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/fivemor.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2026\/07\/4a0953c4-logo-300x86-1.png\",\"contentUrl\":\"https:\/\/fivemor.com\/wp-content\/uploads\/2026\/07\/4a0953c4-logo-300x86-1.png\",\"width\":300,\"height\":86,\"caption\":\"Som2ny Network\"},\"image\":{\"@id\":\"https:\/\/fivemor.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/fivemor.com\/#\/schema\/person\/b85e3c3dc0e1daea076524dc8810c371\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/fivemor.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/729ae85bf62b9917e93538db2f2688ca?s=96&r=g&default=https%3A%2F%2Ffivemor.com%2Fwp-content%2Fplugins%2Fbuddypress-first-letter-avatar%2Fimages%2Fdefault%2F96%2Flatin_a.png\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/729ae85bf62b9917e93538db2f2688ca?s=96&r=g&default=https%3A%2F%2Ffivemor.com%2Fwp-content%2Fplugins%2Fbuddypress-first-letter-avatar%2Fimages%2Fdefault%2F96%2Flatin_a.png\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/fivemor.com\"],\"url\":\"https:\/\/fivemor.com\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Open-source Competition to o3-mini and o1 - Som2ny Network","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/fivemor.com\/?p=179495","og_locale":"en_US","og_type":"article","og_title":"The Open-source Competition to o3-mini and o1 - Som2ny Network","og_description":"In a significant development for the AI community, Agentica and Together AI have released an open-source AI coding model named DeepCoder-14B. Offering code generation capabilities on par with closed-source competitors like OpenAI\u2019s o3-mini and o1, DeepCoder-14B positions itself as a formidable open-source alternative to proprietary models. Moreover, this new model ensures full transparency and developer [&hellip;]","og_url":"https:\/\/fivemor.com\/?p=179495","og_site_name":"Som2ny Network","article_published_time":"2025-04-09T22:35:05+00:00","og_image":[{"width":872,"height":473,"url":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp","type":"image\/webp"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"17 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/fivemor.com\/?p=179495#article","isPartOf":{"@id":"https:\/\/fivemor.com\/?p=179495"},"author":{"name":"admin","@id":"https:\/\/fivemor.com\/#\/schema\/person\/b85e3c3dc0e1daea076524dc8810c371"},"headline":"The Open-source Competition to o3-mini and o1","datePublished":"2025-04-09T22:35:05+00:00","mainEntityOfPage":{"@id":"https:\/\/fivemor.com\/?p=179495"},"wordCount":3066,"commentCount":0,"publisher":{"@id":"https:\/\/fivemor.com\/#organization"},"image":{"@id":"https:\/\/fivemor.com\/?p=179495#primaryimage"},"thumbnailUrl":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp","keywords":["Competition","o3mini","OpenSource"],"articleSection":["Analytics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/fivemor.com\/?p=179495#respond"]}]},{"@type":"WebPage","@id":"https:\/\/fivemor.com\/?p=179495","url":"https:\/\/fivemor.com\/?p=179495","name":"The Open-source Competition to o3-mini and o1 - Som2ny Network","isPartOf":{"@id":"https:\/\/fivemor.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/fivemor.com\/?p=179495#primaryimage"},"image":{"@id":"https:\/\/fivemor.com\/?p=179495#primaryimage"},"thumbnailUrl":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp","datePublished":"2025-04-09T22:35:05+00:00","breadcrumb":{"@id":"https:\/\/fivemor.com\/?p=179495#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/fivemor.com\/?p=179495"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/fivemor.com\/?p=179495#primaryimage","url":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp","contentUrl":"https:\/\/fivemor.com\/wp-content\/uploads\/2025\/04\/Infographic-11-10.webp.webp","width":872,"height":473},{"@type":"BreadcrumbList","@id":"https:\/\/fivemor.com\/?p=179495#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/fivemor.com\/?bp_activities=1"},{"@type":"ListItem","position":2,"name":"The Open-source Competition to o3-mini and o1"}]},{"@type":"WebSite","@id":"https:\/\/fivemor.com\/#website","url":"https:\/\/fivemor.com\/","name":"Som2ny Network","description":"Daily Deals","publisher":{"@id":"https:\/\/fivemor.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/fivemor.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/fivemor.com\/#organization","name":"Som2ny Network","url":"https:\/\/fivemor.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/fivemor.com\/#\/schema\/logo\/image\/","url":"https:\/\/fivemor.com\/wp-content\/uploads\/2026\/07\/4a0953c4-logo-300x86-1.png","contentUrl":"https:\/\/fivemor.com\/wp-content\/uploads\/2026\/07\/4a0953c4-logo-300x86-1.png","width":300,"height":86,"caption":"Som2ny Network"},"image":{"@id":"https:\/\/fivemor.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/fivemor.com\/#\/schema\/person\/b85e3c3dc0e1daea076524dc8810c371","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/fivemor.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/729ae85bf62b9917e93538db2f2688ca?s=96&r=g&default=https%3A%2F%2Ffivemor.com%2Fwp-content%2Fplugins%2Fbuddypress-first-letter-avatar%2Fimages%2Fdefault%2F96%2Flatin_a.png","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/729ae85bf62b9917e93538db2f2688ca?s=96&r=g&default=https%3A%2F%2Ffivemor.com%2Fwp-content%2Fplugins%2Fbuddypress-first-letter-avatar%2Fimages%2Fdefault%2F96%2Flatin_a.png","caption":"admin"},"sameAs":["https:\/\/fivemor.com"],"url":"https:\/\/fivemor.com\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/posts\/179495","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=179495"}],"version-history":[{"count":0,"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/posts\/179495\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=\/wp\/v2\/media\/179496"}],"wp:attachment":[{"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=179495"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=179495"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=179495"},{"taxonomy":"dealstore","embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fdealstore&post=179495"},{"taxonomy":"offerexpiration","embeddable":true,"href":"https:\/\/fivemor.com\/index.php?rest_route=%2Fwp%2Fv2%2Fofferexpiration&post=179495"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}