Mabble Rabble

random ramblings & thunderous tidbits

31 July 2025

Shift In Training LLMs

How a big shift in training LLMs led to a capability explosion

Labels: big data , data science , deep learning , machine learning
Newer Post Older Post Home

Topics

.Net accessibility affective computing agile akka america android animation apache API appengine apple art artificial intelligence automotive bbc BDD beer big data bing blockchain blogs burger c c++ cassandra christmas climate Cloud cognitive collaboration comics commonsense reasoning computer science computer vision conspiracy theory contextual ads cordova crime crypto CSS CXF cyclists Dart data science data.gov data.gov.uk databases dbpedia deep learning derbyjs developer devops disqus distributed systems dmoz drama dropwizard ecommerce economics education energy entertainment ethics event event-driven events facebook fashion finance fireworks fish flash flink food football fraud freebase games git Go Google Google Glass googletv gossip groovy GWT hadoop hbase health heroku home hosting html human resources information retrieval infuencegraph innovation intelligent web intensedebate interaction design interface design internet interviews Java JavaScript JEE jetsons jobsearch jokes julia kafka knowledge graph kotlin legal library lifesciences linked data London mac machine learning maps marketing media memory message-driven metadata meteorjs microservices Microsoft mobile movie movies moz multiagents music musicbrainz natural language processing nature nelson mandela network science neuroscience news nim nodejs nosql ocr odi Olympics online learning ontology open source opencharties opencorporates openspending opinion pair programming paralympics philosophy PHP pizza playframework playn politics predictive analytics programming prolog property public services publishing pyrotechnics python quantum computing R rain rdf reactive recommender reinforcement learning religion research rest restify restlet retail Ruby rust sailsjs sales sandwiches scala scrum security semantic web sentiment analysis sentiments sentiwordnet social media social media analytics social networks socialgraph society software engineering spark sparql sport sports spring squash startups steaks stumbleupon sushi swagger swift taxpayers TDD telecommunications text analytics tomcat toys transit travel trends tv tv drama twisted typesafe ubiquitous computing uk vertx virtual reality visualization web design webcrawler webscraper webservices workplace world bank world cup world event world events yahoo

Word of the Day

Loading...

Wikipedia

Search results

DataTau

Loading...

Search Engine Land

Loading...

Natural Language Processing

Loading...

CMU LTI

Loading...

MIT Tech Review

Loading...

IEEE Spectrum

Loading...

Ars Technica

Loading...

CSAIL

Loading...

Popular Science - Robots

Loading...

ArXiv

Loading...

GitXiv

Loading...

ScienceDaily: AI News

Loading...

VentureBeat

Loading...

AITrends

Loading...

AINews

Loading...

DZone

Loading...

KDnuggets

Loading...

Smashing Magazine

Loading...

ProgrammableWeb

Loading...

AWS Blog

Loading...

NYT Technology

Loading...

The Verge

Loading...

Digital Trends

Loading...

Engadget

Loading...

TechRadar

Loading...

Gizmodo

Loading...

Mashable!

Loading...

Wired

Loading...

The Register

Loading...

The Next Web

Loading...

ReadWrite

Loading...

Lifehacker

Loading...

Today

Loading...

Metacritic

Loading...

TMZ.com

Loading...

Reuters

Loading...

BBC

Loading...

Google News

Loading...

AlJazeera

Loading...

AllSides

Loading...

Fark

Loading...

USATODAY

Loading...

NYT World

Loading...

SCMP

Loading...

BizToc

Loading...

TechCrunch

Loading...

FastCompany

Loading...

Inc

Loading...

TheStreet

Loading...

MarketWatch - Bulletins

Loading...

MarketWatch - StockWatch

Loading...

Stock Picks

Loading...

Investopedia

Loading...

SmithsonianMag

Loading...

Phys

Loading...

Science News

Loading...

New Scientist

Loading...

Scientific American News

Loading...

Live Science

Loading...

Discover: Top Stories

Loading...

Discovery News

Loading...

Popular Mechanics

Loading...

TEDTalks

Loading...

Links

  • AAAI
  • ACL
  • ACM
  • AI2
  • Alan Turing Institute
  • Allegrograph
  • AllenNLP
  • AlternativeTo
  • Amazon
  • Amazon Science
  • Anaconda
  • Apache Foundation
  • AppAdvice
  • Apple
  • Arxiv
  • AssociatedPress
  • AWS
  • BBC
  • Beam
  • BigDataUniversity
  • BigScience Workshop
  • BitBucket
  • Blazegraph
  • Cascading
  • Cassandra
  • CKan
  • Clips
  • Cloudera
  • CMU@LTI
  • Cognitive Science Society
  • Cohere.ai
  • Commonsense
  • Conceptnet
  • Confluent
  • CoreNLP
  • Coursera
  • CSAIL
  • Cyc
  • Databricks
  • DatabricksLabs
  • DataScienceMasters
  • DataScienceWeekly
  • Datastax
  • DBEngines
  • DBPedia
  • DeepLearning
  • Deeplearning4J
  • DeepMind
  • Deepset
  • Dice
  • DigitalOcean
  • DublinCore
  • DZone
  • EBay
  • Ed@informatics
  • EDMC
  • Edx
  • Elastic
  • EleutherAI
  • Ethical Consumer
  • Flink
  • G2Crowd
  • Gate
  • Gensim
  • Getty
  • Github
  • Global Research
  • Google
  • Google Dataset
  • Google Research
  • Google Trends
  • Grammatical Framework
  • GraphQL
  • Groovy
  • Hackernoon
  • Hadoop
  • HBO
  • Heritrix
  • Heroku
  • Hortonworks
  • HuggingFace
  • Institute for Quantitative Social Science
  • Janusgraph
  • Java
  • John Snow Labs
  • JSON-LD
  • Julia
  • Kaggle
  • KBpedia
  • KDNuggets
  • Kotlin
  • LaionAI
  • LangChain
  • Lazy Programmer
  • LDC
  • Lemon
  • LinkedData
  • Llamaindex
  • LonelyPlanet
  • Lucene
  • Manning
  • MapR
  • MediaBiasGroup
  • Mediacloud
  • Meetup
  • MetaResearch
  • Microservices.io
  • MIT Courseware
  • MongoDB
  • Mozilla
  • MXNET
  • Netflix
  • NetflixOSS
  • NLP Progress
  • Nodejs
  • NOW Publishers
  • NVIDIA
  • OAQA
  • Ontocord
  • Ontotext
  • OpenAI
  • OpenCV
  • OpenMath
  • OpenNLP
  • Oracle
  • Oreilly
  • OWL 2
  • Packtpub
  • Paperswithcode
  • PoolParty
  • Pragmatic Bookshelf
  • PyData
  • Python
  • PyTorch
  • PyWhy
  • R
  • RDF
  • RDFS
  • Redis
  • ResearchGate
  • Scala
  • Scholarpedia
  • Schrodinger
  • scikit-learn
  • Scrapy
  • Scylladb
  • Semantic Web
  • Skillsmatter
  • SKOS
  • SmashingMagazine
  • Solace
  • Solr
  • SoundCloud
  • Spark
  • SPARQL
  • Stackshare
  • Stanbol
  • StanfordNLP
  • Stardog
  • Strata
  • Streamsets
  • SWRL
  • Tatsu
  • Tensorflow
  • The Marshall Project
  • Theano
  • TheTopTens
  • ThomsonReuters
  • Timeout
  • Tinkerpop
  • TIOBE
  • Titan
  • Together
  • Tutorialspoint
  • Twitter
  • Udacity
  • Udemy
  • UIMA
  • Umbel
  • VastAI
  • W3C
  • W3C Community Groups
  • W3CSchools
  • Wazo
  • Wikidata
  • Workforce Data Initiative
  • XPath
  • XQuery
  • Youtube
Posts
Atom
Posts
Comments
Atom
Comments

Archive

  • ▼  2025 ( 1194 )
    • ►  October ( 86 )
    • ►  September ( 109 )
    • ►  August ( 172 )
    • ▼  July ( 158 )
      • AI Overviews Cause Drop in Search Clicks
      • Shift In Training LLMs
      • 2025 Job Cuts
      • NeRF Papers
      • NerfStudio
      • ML Papers of The Week
      • Top Research Papers on GenAI
      • LLM Research Papers
      • ArXiv AI
      • Most Influential ArXiv Papers
      • Bagel
      • Multi-Objective Recommendation
      • Small Language Models
      • Do LLMs Latently Perform Multi-Hop Reasoning
      • Elicit
      • Causal AI
      • List of LLMs
      • Llama 4 Architecture
      • The Obtuse AI Community
      • TGI
      • Comparing Open-Source Agentic Frameworks
      • R4: Shift in Global Currency Dynamics
      • Ghosting the Recruiter
      • Life In a Treehouse Mansion
      • The Lenses We Wear
      • ML Lifecycles for RAG and GraphRAG
      • Cloud Folder Patterns
      • Serverless Functions
      • Topic Modeling
      • BERTopic
      • Why Every Lottery is a Scam
      • Outdated Recruitment Practices and Bottlenecks
      • LLM Deployment
      • LLM Training Frameworks
      • Slurm
      • LlamaFactory
      • Affective Computing and Chatbots
      • Pro-Israel Companies
      • Semi-Submersible Speedboats
      • Ideogram
      • Crafting Chart Topping K-Pop Hits
      • Datasets for Proverbs, Quotes, and Affirmations
      • SKOS Extraction from Complex Data Sources
      • Embedding Knowledge Graphs
      • DeepSpeed
      • Backyard Rollercoaster
      • Homemade Hoverboards
      • Aeroponics and Hydroponics
      • Oceanography and Marine Biology
      • Environmental Monitoring
      • Materials Science
      • Precision Agriculture
      • Autonomous Vehicles
      • Indispensible Role of Internal Ethics
      • Beyond the Numbers
      • Unifying Principles of AI Engines
      • Four I's
      • Fake News Datasets
      • AI Standards Exchange Database
      • AI Podcasts
      • Neuroscience, AI, and LLM Limitations
      • GS SecDB
      • GNNs and Stock Market
      • GNNs and Investment Insights
      • GNNs and Private Equity
      • Spirituality, Mind, and Cognition
      • GraphRAG Evaluation
      • Synergy of MAS and GraphRAG
      • Advanced GraphRAG
      • Effective Prompt Patterns for GraphRAG
      • Limitations of ReAct
      • Design Patterns in GraphRAG
      • MCP is Not Ideal for Agentic AI
      • War Cycles of Profits and Global Instability
      • War Strategies
      • Why Bitcoin is considered unIslamic
      • Celestial Kiss-Cam Catastrophe
      • Autonomous Architect
      • Whispers of the Wind, Roar of the Girl
      • The GCC Squabbles
      • Bibi: Laundry, Land, and Genocide
      • The Great File Fiasco
      • RAG, Agents, LLMs, and Free GPTs
      • GenAI Landscape 2025
      • Vertex AI and Bedrock
      • Ultimate Guide to Fine-Tuning LLMs
      • Fine-Tuning LLMs
      • LLM as a Judge
      • Robocop AI
      • AI for Detection and Intervention in Exploitation
      • Capital Punishment, Protection, and Justice
      • Dynamics of Female Exploitation
      • Independent Research
      • Pessimistic Professors and Academia
      • Why Israelis Are Not True Jews
      • Integrated Approaches to GraphRAG
      • Chunking Strategies for GenAI
      • Self-Sustainable Smart Homes
      • Quantum and Blockchain in AGI
      • Intelligent Web and Cognitive Architectures
    • ►  June ( 152 )
    • ►  May ( 112 )
    • ►  April ( 65 )
    • ►  March ( 96 )
    • ►  February ( 118 )
    • ►  January ( 126 )
  • ►  2024 ( 157 )
    • ►  December ( 81 )
    • ►  November ( 29 )
    • ►  October ( 32 )
    • ►  September ( 2 )
    • ►  June ( 1 )
    • ►  May ( 6 )
    • ►  April ( 2 )
    • ►  March ( 3 )
    • ►  January ( 1 )
  • ►  2023 ( 94 )
    • ►  December ( 16 )
    • ►  November ( 3 )
    • ►  October ( 4 )
    • ►  September ( 9 )
    • ►  August ( 7 )
    • ►  July ( 11 )
    • ►  June ( 11 )
    • ►  May ( 11 )
    • ►  April ( 8 )
    • ►  March ( 10 )
    • ►  February ( 2 )
    • ►  January ( 2 )
  • ►  2022 ( 133 )
    • ►  December ( 16 )
    • ►  November ( 5 )
    • ►  October ( 7 )
    • ►  September ( 8 )
    • ►  August ( 14 )
    • ►  July ( 29 )
    • ►  June ( 18 )
    • ►  May ( 16 )
    • ►  April ( 9 )
    • ►  March ( 7 )
    • ►  February ( 2 )
    • ►  January ( 2 )
  • ►  2021 ( 90 )
    • ►  December ( 2 )
    • ►  November ( 1 )
    • ►  August ( 7 )
    • ►  July ( 4 )
    • ►  June ( 33 )
    • ►  May ( 10 )
    • ►  April ( 5 )
    • ►  March ( 8 )
    • ►  February ( 5 )
    • ►  January ( 15 )
  • ►  2020 ( 229 )
    • ►  December ( 39 )
    • ►  November ( 12 )
    • ►  October ( 10 )
    • ►  September ( 14 )
    • ►  August ( 10 )
    • ►  July ( 21 )
    • ►  June ( 18 )
    • ►  May ( 14 )
    • ►  April ( 14 )
    • ►  March ( 26 )
    • ►  February ( 20 )
    • ►  January ( 31 )
  • ►  2019 ( 256 )
    • ►  December ( 19 )
    • ►  November ( 17 )
    • ►  October ( 67 )
    • ►  September ( 17 )
    • ►  August ( 19 )
    • ►  July ( 15 )
    • ►  June ( 40 )
    • ►  May ( 27 )
    • ►  April ( 11 )
    • ►  March ( 3 )
    • ►  February ( 1 )
    • ►  January ( 20 )
  • ►  2018 ( 133 )
    • ►  December ( 17 )
    • ►  October ( 1 )
    • ►  September ( 1 )
    • ►  August ( 2 )
    • ►  July ( 4 )
    • ►  June ( 12 )
    • ►  May ( 9 )
    • ►  April ( 29 )
    • ►  March ( 10 )
    • ►  February ( 23 )
    • ►  January ( 25 )
  • ►  2017 ( 275 )
    • ►  December ( 24 )
    • ►  November ( 9 )
    • ►  October ( 25 )
    • ►  September ( 28 )
    • ►  August ( 4 )
    • ►  July ( 8 )
    • ►  June ( 5 )
    • ►  May ( 20 )
    • ►  April ( 35 )
    • ►  March ( 57 )
    • ►  February ( 37 )
    • ►  January ( 23 )
  • ►  2016 ( 90 )
    • ►  December ( 2 )
    • ►  November ( 4 )
    • ►  October ( 13 )
    • ►  September ( 24 )
    • ►  August ( 14 )
    • ►  June ( 11 )
    • ►  May ( 6 )
    • ►  April ( 3 )
    • ►  March ( 9 )
    • ►  February ( 4 )
  • ►  2015 ( 36 )
    • ►  December ( 2 )
    • ►  November ( 1 )
    • ►  October ( 4 )
    • ►  September ( 2 )
    • ►  July ( 3 )
    • ►  May ( 2 )
    • ►  April ( 1 )
    • ►  March ( 4 )
    • ►  February ( 9 )
    • ►  January ( 8 )
  • ►  2014 ( 201 )
    • ►  December ( 1 )
    • ►  November ( 8 )
    • ►  October ( 12 )
    • ►  September ( 11 )
    • ►  August ( 12 )
    • ►  July ( 19 )
    • ►  June ( 22 )
    • ►  May ( 11 )
    • ►  April ( 27 )
    • ►  March ( 46 )
    • ►  February ( 24 )
    • ►  January ( 8 )
  • ►  2013 ( 77 )
    • ►  December ( 39 )
    • ►  October ( 4 )
    • ►  September ( 2 )
    • ►  August ( 9 )
    • ►  July ( 5 )
    • ►  June ( 3 )
    • ►  May ( 4 )
    • ►  April ( 5 )
    • ►  March ( 3 )
    • ►  February ( 3 )
  • ►  2012 ( 35 )
    • ►  December ( 14 )
    • ►  November ( 2 )
    • ►  September ( 7 )
    • ►  August ( 4 )
    • ►  July ( 8 )
Copyright © 2025. All rights reserved. Theme images by Ollustrator. Powered by Blogger.