Mabble Rabble

random ramblings & thunderous tidbits

12 August 2025

LLM Pre-Training and Post-Training

LLM Pre-Training and Post-Training

Labels: big data , data science , deep learning , machine learning
Newer Post Older Post Home

Topics

.Net accessibility affective computing agile akka america android animation apache API appengine apple art artificial intelligence automotive bbc BDD beer big data bing blockchain blogs burger c c++ cassandra christmas climate Cloud cognitive collaboration comics commonsense reasoning computer science computer vision conspiracy theory contextual ads cordova crime crypto CSS CXF cyclists Dart data science data.gov data.gov.uk databases dbpedia deep learning derbyjs developer devops disqus distributed systems dmoz drama dropwizard ecommerce economics education energy entertainment ethics event event-driven events facebook fashion finance fireworks fish flash flink food football fraud freebase games git Go Google Google Glass googletv gossip groovy GWT hadoop hbase health heroku home hosting html human resources information retrieval infuencegraph innovation intelligent web intensedebate interaction design interface design internet interviews Java JavaScript JEE jetsons jobsearch jokes julia kafka knowledge graph kotlin legal library lifesciences linked data London mac machine learning maps marketing media memory message-driven metadata meteorjs microservices Microsoft mobile movie movies moz multiagents music musicbrainz natural language processing nature nelson mandela network science neuroscience news nim nodejs nosql ocr odi Olympics online learning ontology open source opencharties opencorporates openspending opinion pair programming paralympics philosophy PHP pizza playframework playn politics predictive analytics programming prolog property public services publishing pyrotechnics python quantum computing R rain rdf reactive recommender reinforcement learning religion research rest restify restlet retail Ruby rust sailsjs sales sandwiches scala scrum security semantic web sentiment analysis sentiments sentiwordnet social media social media analytics social networks socialgraph society software engineering spark sparql sport sports spring squash startups steaks stumbleupon sushi swagger swift taxpayers TDD telecommunications text analytics tomcat toys transit travel trends tv tv drama twisted typesafe ubiquitous computing uk vertx virtual reality visualization web design webcrawler webscraper webservices workplace world bank world cup world event world events yahoo

Word of the Day

Loading...

Wikipedia

Search results

DataTau

Loading...

Search Engine Land

Loading...

Natural Language Processing

Loading...

CMU LTI

Loading...

MIT Tech Review

Loading...

IEEE Spectrum

Loading...

Ars Technica

Loading...

CSAIL

Loading...

Popular Science - Robots

Loading...

ArXiv

Loading...

GitXiv

Loading...

ScienceDaily: AI News

Loading...

VentureBeat

Loading...

AITrends

Loading...

AINews

Loading...

DZone

Loading...

KDnuggets

Loading...

Smashing Magazine

Loading...

ProgrammableWeb

Loading...

AWS Blog

Loading...

NYT Technology

Loading...

The Verge

Loading...

Digital Trends

Loading...

Engadget

Loading...

TechRadar

Loading...

Gizmodo

Loading...

Mashable!

Loading...

Wired

Loading...

The Register

Loading...

The Next Web

Loading...

ReadWrite

Loading...

Lifehacker

Loading...

Today

Loading...

Metacritic

Loading...

TMZ.com

Loading...

Reuters

Loading...

BBC

Loading...

Google News

Loading...

AlJazeera

Loading...

AllSides

Loading...

Fark

Loading...

USATODAY

Loading...

NYT World

Loading...

SCMP

Loading...

TechCrunch

Loading...

FastCompany

Loading...

Inc

Loading...

TheStreet

Loading...

MarketWatch - Bulletins

Loading...

MarketWatch - StockWatch

Loading...

Stock Picks

Loading...

Investopedia

Loading...

SmithsonianMag

Loading...

Phys

Loading...

Science News

Loading...

New Scientist

Loading...

Scientific American News

Loading...

Live Science

Loading...

Discover: Top Stories

Loading...

Discovery News

Loading...

Popular Mechanics

Loading...

TEDTalks

Loading...

Links

  • AAAI
  • ACL
  • ACM
  • AI2
  • Alan Turing Institute
  • Allegrograph
  • AllenNLP
  • AlternativeTo
  • Amazon
  • Amazon Science
  • Anaconda
  • Apache Foundation
  • AppAdvice
  • Apple
  • Arxiv
  • AssociatedPress
  • AWS
  • BBC
  • Beam
  • BigDataUniversity
  • BigScience Workshop
  • BitBucket
  • Blazegraph
  • Cascading
  • Cassandra
  • CKan
  • Clips
  • Cloudera
  • CMU@LTI
  • Cognitive Science Society
  • Cohere.ai
  • Commonsense
  • Conceptnet
  • Confluent
  • CoreNLP
  • Coursera
  • CSAIL
  • Cyc
  • Databricks
  • DatabricksLabs
  • DataScienceMasters
  • DataScienceWeekly
  • Datastax
  • DBEngines
  • DBPedia
  • DeepLearning
  • Deeplearning4J
  • DeepMind
  • Deepset
  • Dice
  • DigitalOcean
  • DublinCore
  • DZone
  • EBay
  • Ed@informatics
  • EDMC
  • Edx
  • Elastic
  • EleutherAI
  • Ethical Consumer
  • Flink
  • G2Crowd
  • Gate
  • Gensim
  • Getty
  • Github
  • Global Research
  • Google
  • Google Dataset
  • Google Research
  • Google Trends
  • Grammatical Framework
  • GraphQL
  • Groovy
  • Hackernoon
  • Hadoop
  • HBO
  • Heritrix
  • Heroku
  • Hortonworks
  • HuggingFace
  • Institute for Quantitative Social Science
  • Janusgraph
  • Java
  • John Snow Labs
  • JSON-LD
  • Julia
  • Kaggle
  • KBpedia
  • KDNuggets
  • Kotlin
  • LaionAI
  • LangChain
  • Lazy Programmer
  • LDC
  • Lemon
  • LinkedData
  • Llamaindex
  • LonelyPlanet
  • Lucene
  • Manning
  • MapR
  • MediaBiasGroup
  • Mediacloud
  • Meetup
  • MetaResearch
  • Microservices.io
  • MIT Courseware
  • MongoDB
  • Mozilla
  • MXNET
  • Netflix
  • NetflixOSS
  • NLP Progress
  • Nodejs
  • NOW Publishers
  • NVIDIA
  • OAQA
  • Ontocord
  • Ontotext
  • OpenAI
  • OpenCV
  • OpenMath
  • OpenNLP
  • Oracle
  • Oreilly
  • OWL 2
  • Packtpub
  • Paperswithcode
  • PoolParty
  • Pragmatic Bookshelf
  • PyData
  • Python
  • PyTorch
  • PyWhy
  • R
  • RDF
  • RDFS
  • Redis
  • ResearchGate
  • Scala
  • Scholarpedia
  • Schrodinger
  • scikit-learn
  • Scrapy
  • Scylladb
  • Semantic Web
  • Skillsmatter
  • SKOS
  • SmashingMagazine
  • Solace
  • Solr
  • SoundCloud
  • Spark
  • SPARQL
  • Stackshare
  • Stanbol
  • StanfordNLP
  • Stardog
  • Strata
  • Streamsets
  • SWRL
  • Tatsu
  • Tensorflow
  • The Marshall Project
  • Theano
  • TheTopTens
  • ThomsonReuters
  • Timeout
  • Tinkerpop
  • TIOBE
  • Titan
  • Together
  • Tutorialspoint
  • Twitter
  • Udacity
  • Udemy
  • UIMA
  • Umbel
  • VastAI
  • W3C
  • W3C Community Groups
  • W3CSchools
  • Wazo
  • Wikidata
  • Workforce Data Initiative
  • XPath
  • XQuery
  • Youtube
Posts
Atom
Posts
Comments
Atom
Comments

Archive

  • ▼  2025 ( 978 )
    • ▼  August ( 151 )
      • PDF and GenAI
      • Modern Dating is Complicated
      • AI Personhood Trap
      • Agentic Societies
      • Societal Dynamics
      • Nano Banana
      • Anthropic Chrome Extension
      • Protect Your Creative Ideas
      • Browser Use
      • Open SWE
      • Open WebUI
      • ASI-Arch
      • Vertu
      • Cognitive Architecture Research Groups
      • Sigma
      • LIDA
      • CLARION
      • SOAR
      • ACT-R
      • Superintelligence Strategy
      • Superintelligence and Consciousness
      • ChatGPT Safeguards Fail
      • ChatGPT Killed My Son
      • 8 Steps to Becoming an AI Engineer
      • Vision AI Models See Illusions
      • Tinker with LLMs
      • ESG Conundrum - A Mindfield of Expectations
      • Uncertainty in Global Job Market
      • Top MIT Courses on AI
      • Project NANDA
      • Sovereign AI
      • MIT AI Hype Cycle
      • AI Hiring Stops at Meta
      • Open-Source GenAI Observability
      • AI Agents Are Delivering on Semantic Web
      • Hanging Cable Problem
      • Trump's Hypocritical Foreign Policy
      • The Cost of Hegemony
      • Putin as a Pragmatic Leader
      • Russia's Foray in Electrical Propulsion
      • Is AI Winter Looming in 2025?
      • Australia's Bank Forced to Rehire
      • Alaskan Meeting, Was it Diplomacy or Disbelief?
      • How to Jailbreak LLMs
      • Perplexity Comet
      • Finland's Dismal Comparison
      • Meloni Maneuver
      • The White House Roasting
      • Russia-Ukraine Conflict
      • The False Narrative of Skills Shortage in AI
      • Ugly Truths of Amazon and AWS
      • The Russia-Palestine Bond
      • Sprinklr
      • Databricks
      • The Spark of Middle East Unification
      • Reforming The Monetary Authority
      • Global Geopolitical Realignment
      • Is GPT5 worse than GPT4o?
      • Data Lakes 101
      • Work Visa Reliance
      • Russia's Resilient Tech Sector
      • Reality of India's Tech Sector
      • How Acquisitions Can Stifle Innovation
      • The Race for Superintelligence
      • When AI Hype Overshadows Substance
      • GNN 2025
      • Semantic KG 2025
      • GPT5 Not an AI Evolution
      • Meta allows creepy chatbots
      • Pint-Size Gemma
      • US Government Drops Grok
      • OpenSPG
      • OpenKG
      • Meta
      • List of Datasets for ML Research
      • Legal Datasets
      • Awesome Legal Data
      • Google to block crypto wallets
      • ACORD Dataset
      • MAUD Dataset
      • CUAD Dataset
      • Kalash Valley
      • A Backpacker's Paradise
      • Online Advertising Trends
      • What is the path forward?
      • Future of Social Media
      • GNN and Online Dating
      • Future of AI Beyond the GPU Monolith
      • Agentic Frameworks Fall Short
      • Figurative Speech and GNN
      • Automated KG Creation with GenAI
      • Hybrid Retrieval in GraphRAG
      • LangChain
      • Jupyter Notebooks
      • Anaconda
      • Zotero
      • Protégé
      • RedMonk Language Rankings
      • Degradation in LLM Simulated Reasoning
      • GitHub at Risk
    • ►  July ( 158 )
    • ►  June ( 152 )
    • ►  May ( 112 )
    • ►  April ( 65 )
    • ►  March ( 96 )
    • ►  February ( 118 )
    • ►  January ( 126 )
  • ►  2024 ( 157 )
    • ►  December ( 81 )
    • ►  November ( 29 )
    • ►  October ( 32 )
    • ►  September ( 2 )
    • ►  June ( 1 )
    • ►  May ( 6 )
    • ►  April ( 2 )
    • ►  March ( 3 )
    • ►  January ( 1 )
  • ►  2023 ( 94 )
    • ►  December ( 16 )
    • ►  November ( 3 )
    • ►  October ( 4 )
    • ►  September ( 9 )
    • ►  August ( 7 )
    • ►  July ( 11 )
    • ►  June ( 11 )
    • ►  May ( 11 )
    • ►  April ( 8 )
    • ►  March ( 10 )
    • ►  February ( 2 )
    • ►  January ( 2 )
  • ►  2022 ( 133 )
    • ►  December ( 16 )
    • ►  November ( 5 )
    • ►  October ( 7 )
    • ►  September ( 8 )
    • ►  August ( 14 )
    • ►  July ( 29 )
    • ►  June ( 18 )
    • ►  May ( 16 )
    • ►  April ( 9 )
    • ►  March ( 7 )
    • ►  February ( 2 )
    • ►  January ( 2 )
  • ►  2021 ( 90 )
    • ►  December ( 2 )
    • ►  November ( 1 )
    • ►  August ( 7 )
    • ►  July ( 4 )
    • ►  June ( 33 )
    • ►  May ( 10 )
    • ►  April ( 5 )
    • ►  March ( 8 )
    • ►  February ( 5 )
    • ►  January ( 15 )
  • ►  2020 ( 229 )
    • ►  December ( 39 )
    • ►  November ( 12 )
    • ►  October ( 10 )
    • ►  September ( 14 )
    • ►  August ( 10 )
    • ►  July ( 21 )
    • ►  June ( 18 )
    • ►  May ( 14 )
    • ►  April ( 14 )
    • ►  March ( 26 )
    • ►  February ( 20 )
    • ►  January ( 31 )
  • ►  2019 ( 256 )
    • ►  December ( 19 )
    • ►  November ( 17 )
    • ►  October ( 67 )
    • ►  September ( 17 )
    • ►  August ( 19 )
    • ►  July ( 15 )
    • ►  June ( 40 )
    • ►  May ( 27 )
    • ►  April ( 11 )
    • ►  March ( 3 )
    • ►  February ( 1 )
    • ►  January ( 20 )
  • ►  2018 ( 133 )
    • ►  December ( 17 )
    • ►  October ( 1 )
    • ►  September ( 1 )
    • ►  August ( 2 )
    • ►  July ( 4 )
    • ►  June ( 12 )
    • ►  May ( 9 )
    • ►  April ( 29 )
    • ►  March ( 10 )
    • ►  February ( 23 )
    • ►  January ( 25 )
  • ►  2017 ( 275 )
    • ►  December ( 24 )
    • ►  November ( 9 )
    • ►  October ( 25 )
    • ►  September ( 28 )
    • ►  August ( 4 )
    • ►  July ( 8 )
    • ►  June ( 5 )
    • ►  May ( 20 )
    • ►  April ( 35 )
    • ►  March ( 57 )
    • ►  February ( 37 )
    • ►  January ( 23 )
  • ►  2016 ( 90 )
    • ►  December ( 2 )
    • ►  November ( 4 )
    • ►  October ( 13 )
    • ►  September ( 24 )
    • ►  August ( 14 )
    • ►  June ( 11 )
    • ►  May ( 6 )
    • ►  April ( 3 )
    • ►  March ( 9 )
    • ►  February ( 4 )
  • ►  2015 ( 36 )
    • ►  December ( 2 )
    • ►  November ( 1 )
    • ►  October ( 4 )
    • ►  September ( 2 )
    • ►  July ( 3 )
    • ►  May ( 2 )
    • ►  April ( 1 )
    • ►  March ( 4 )
    • ►  February ( 9 )
    • ►  January ( 8 )
  • ►  2014 ( 201 )
    • ►  December ( 1 )
    • ►  November ( 8 )
    • ►  October ( 12 )
    • ►  September ( 11 )
    • ►  August ( 12 )
    • ►  July ( 19 )
    • ►  June ( 22 )
    • ►  May ( 11 )
    • ►  April ( 27 )
    • ►  March ( 46 )
    • ►  February ( 24 )
    • ►  January ( 8 )
  • ►  2013 ( 77 )
    • ►  December ( 39 )
    • ►  October ( 4 )
    • ►  September ( 2 )
    • ►  August ( 9 )
    • ►  July ( 5 )
    • ►  June ( 3 )
    • ►  May ( 4 )
    • ►  April ( 5 )
    • ►  March ( 3 )
    • ►  February ( 3 )
  • ►  2012 ( 35 )
    • ►  December ( 14 )
    • ►  November ( 2 )
    • ►  September ( 7 )
    • ►  August ( 4 )
    • ►  July ( 8 )
Copyright © 2025. All rights reserved. Theme images by Ollustrator. Powered by Blogger.