Mabble Rabble

random ramblings & thunderous tidbits

10 July 2025

LLM Benchmarks are Lying

LLM Benchmarks are Lying

Labels: big data , data science , deep learning , machine learning
Newer Post Older Post Home

Topics

.Net accessibility affective computing agile akka america android animation apache API appengine apple art artificial intelligence automotive bbc BDD beer big data bing blockchain blogs burger c c++ cassandra christmas climate Cloud cognitive collaboration comics commonsense reasoning computer science computer vision conspiracy theory contextual ads cordova crime crypto CSS CXF cyclists Dart data science data.gov data.gov.uk databases dbpedia deep learning derbyjs developer devops disqus distributed systems dmoz drama dropwizard ecommerce economics education energy entertainment ethics event event-driven events facebook fashion finance fireworks fish flash flink food football fraud freebase games git Go Google Google Glass googletv gossip groovy GWT hadoop hbase health heroku home hosting html human resources information retrieval infuencegraph innovation intelligent web intensedebate interaction design interface design internet interviews Java JavaScript JEE jetsons jobsearch jokes julia kafka knowledge graph kotlin legal library lifesciences linked data London mac machine learning maps marketing media memory message-driven metadata meteorjs microservices Microsoft mobile movie movies moz multiagents music musicbrainz natural language processing nature nelson mandela network science neuroscience news nim nodejs nosql ocr odi Olympics online learning ontology open source opencharties opencorporates openspending opinion pair programming paralympics philosophy PHP pizza playframework playn politics predictive analytics programming prolog property public services publishing pyrotechnics python quantum computing R rain rdf reactive recommender reinforcement learning religion research rest restify restlet retail Ruby rust sailsjs sales sandwiches scala scrum security semantic web sentiment analysis sentiments sentiwordnet social media social media analytics social networks socialgraph society software engineering spark sparql sport sports spring squash startups steaks stumbleupon sushi swagger swift taxpayers TDD telecommunications text analytics tomcat toys transit travel trends tv tv drama twisted typesafe ubiquitous computing uk vertx virtual reality visualization web design webcrawler webscraper webservices workplace world bank world cup world event world events yahoo

Word of the Day

Loading...

Wikipedia

Search results

DataTau

Loading...

Search Engine Land

Loading...

Natural Language Processing

Loading...

CMU LTI

Loading...

MIT Tech Review

Loading...

IEEE Spectrum

Loading...

Ars Technica

Loading...

CSAIL

Loading...

Popular Science - Robots

Loading...

ArXiv

Loading...

GitXiv

Loading...

ScienceDaily: AI News

Loading...

VentureBeat

Loading...

AITrends

Loading...

AINews

Loading...

DZone

Loading...

KDnuggets

Loading...

Smashing Magazine

Loading...

ProgrammableWeb

Loading...

AWS Blog

Loading...

NYT Technology

Loading...

The Verge

Loading...

Digital Trends

Loading...

Engadget

Loading...

TechRadar

Loading...

Gizmodo

Loading...

Mashable!

Loading...

Wired

Loading...

The Register

Loading...

The Next Web

Loading...

ReadWrite

Loading...

Lifehacker

Loading...

Today

Loading...

Metacritic

Loading...

TMZ.com

Loading...

Reuters

Loading...

BBC

Loading...

Google News

Loading...

AlJazeera

Loading...

AllSides

Loading...

Fark

Loading...

USATODAY

Loading...

NYT World

Loading...

SCMP

Loading...

TechCrunch

Loading...

FastCompany

Loading...

Inc

Loading...

TheStreet

Loading...

MarketWatch - Bulletins

Loading...

MarketWatch - StockWatch

Loading...

Stock Picks

Loading...

Investopedia

Loading...

SmithsonianMag

Loading...

Phys

Loading...

Science News

Loading...

New Scientist

Loading...

Scientific American News

Loading...

Live Science

Loading...

Discover: Top Stories

Loading...

Discovery News

Loading...

Popular Mechanics

Loading...

TEDTalks

Loading...

Links

  • AAAI
  • ACL
  • ACM
  • AI2
  • Alan Turing Institute
  • Allegrograph
  • AllenNLP
  • AlternativeTo
  • Amazon
  • Amazon Science
  • Anaconda
  • Apache Foundation
  • AppAdvice
  • Apple
  • Arxiv
  • AssociatedPress
  • AWS
  • BBC
  • Beam
  • BigDataUniversity
  • BigScience Workshop
  • BitBucket
  • Blazegraph
  • Cascading
  • Cassandra
  • CKan
  • Clips
  • Cloudera
  • CMU@LTI
  • Cognitive Science Society
  • Cohere.ai
  • Commonsense
  • Conceptnet
  • Confluent
  • CoreNLP
  • Coursera
  • CSAIL
  • Cyc
  • Databricks
  • DatabricksLabs
  • DataScienceMasters
  • DataScienceWeekly
  • Datastax
  • DBEngines
  • DBPedia
  • DeepLearning
  • Deeplearning4J
  • DeepMind
  • Deepset
  • Dice
  • DigitalOcean
  • DublinCore
  • DZone
  • EBay
  • Ed@informatics
  • EDMC
  • Edx
  • Elastic
  • EleutherAI
  • Ethical Consumer
  • Flink
  • G2Crowd
  • Gate
  • Gensim
  • Getty
  • Github
  • Global Research
  • Google
  • Google Dataset
  • Google Research
  • Google Trends
  • Grammatical Framework
  • GraphQL
  • Groovy
  • Hackernoon
  • Hadoop
  • HBO
  • Heritrix
  • Heroku
  • Hortonworks
  • HuggingFace
  • Institute for Quantitative Social Science
  • Janusgraph
  • Java
  • John Snow Labs
  • JSON-LD
  • Julia
  • Kaggle
  • KBpedia
  • KDNuggets
  • Kotlin
  • LaionAI
  • LangChain
  • Lazy Programmer
  • LDC
  • Lemon
  • LinkedData
  • Llamaindex
  • LonelyPlanet
  • Lucene
  • Manning
  • MapR
  • MediaBiasGroup
  • Mediacloud
  • Meetup
  • MetaResearch
  • Microservices.io
  • MIT Courseware
  • MongoDB
  • Mozilla
  • MXNET
  • Netflix
  • NetflixOSS
  • NLP Progress
  • Nodejs
  • NOW Publishers
  • NVIDIA
  • OAQA
  • Ontocord
  • Ontotext
  • OpenAI
  • OpenCV
  • OpenMath
  • OpenNLP
  • Oracle
  • Oreilly
  • OWL 2
  • Packtpub
  • Paperswithcode
  • PoolParty
  • Pragmatic Bookshelf
  • PyData
  • Python
  • PyTorch
  • PyWhy
  • R
  • RDF
  • RDFS
  • Redis
  • ResearchGate
  • Scala
  • Scholarpedia
  • Schrodinger
  • scikit-learn
  • Scrapy
  • Scylladb
  • Semantic Web
  • Skillsmatter
  • SKOS
  • SmashingMagazine
  • Solace
  • Solr
  • SoundCloud
  • Spark
  • SPARQL
  • Stackshare
  • Stanbol
  • StanfordNLP
  • Stardog
  • Strata
  • Streamsets
  • SWRL
  • Tatsu
  • Tensorflow
  • The Marshall Project
  • Theano
  • TheTopTens
  • ThomsonReuters
  • Timeout
  • Tinkerpop
  • TIOBE
  • Titan
  • Together
  • Tutorialspoint
  • Twitter
  • Udacity
  • Udemy
  • UIMA
  • Umbel
  • VastAI
  • W3C
  • W3C Community Groups
  • W3CSchools
  • Wazo
  • Wikidata
  • Workforce Data Initiative
  • XPath
  • XQuery
  • Youtube
Posts
Atom
Posts
Comments
Atom
Comments

Archive

  • ▼  2025 ( 714 )
    • ▼  July ( 45 )
      • ICLR 2025 Papers
      • ICML 2025 Papers
      • Vellum Leaderboard
      • Automating Legal Work
      • AI is Disrupting Advertising Industry
      • The Postulate Algorithms of AI
      • Koranic Principles in AI Algorithms
      • What is AGI? Nobody Agrees
      • Why 2025 Will Not Be Year For Agentic AI
      • LLM Benchmarks are Lying
      • Middle Eastern and Persian Philosophers
      • Awesome RAG Evaluation
      • Awesome RAG
      • Proton Native
      • Fastify
      • Geometric Link
      • Stingy Tortilla
      • The Complex Ethics of Banking
      • Decentralization of AI
      • The Unfettered Sky: A Wingsuit Flight
      • AI and Transformative Post Office Services
      • Missing Persons Search
      • Perceptions of PhD Employees
      • Google's Bleak Prospects
      • The Shadow Economies of Online Marketing
      • Google: Arrogant, Greedy, and Money-Grubbing
      • Google AI Tools Integration to Workspace
      • Centralization to Self-Sovereignty with AI Agents
      • Data Flywheel
      • Growing Up in Mixed-Faith Households
      • Digital Radio and AI
      • The Future of Simulation Games
      • DC vs Marvel Characters
      • Debt-Free Living
      • The Golden Algorithms of AI
      • The Curious Case of AI
      • Electricity Solutions in Improverished Regions
      • India's Duplicity in BRICS
      • June 2025 Best Papers and GenAI Progress
      • Task Synchronization Using Chunks and Rules
      • Nanobots and Medicine
      • Science of Flight and AI Transformation
      • What Lies Beyond Amazon
      • AI Household Cleaners
      • Elon Musk and Friction in White House
    • ►  June ( 152 )
    • ►  May ( 112 )
    • ►  April ( 65 )
    • ►  March ( 96 )
    • ►  February ( 118 )
    • ►  January ( 126 )
  • ►  2024 ( 157 )
    • ►  December ( 81 )
    • ►  November ( 29 )
    • ►  October ( 32 )
    • ►  September ( 2 )
    • ►  June ( 1 )
    • ►  May ( 6 )
    • ►  April ( 2 )
    • ►  March ( 3 )
    • ►  January ( 1 )
  • ►  2023 ( 94 )
    • ►  December ( 16 )
    • ►  November ( 3 )
    • ►  October ( 4 )
    • ►  September ( 9 )
    • ►  August ( 7 )
    • ►  July ( 11 )
    • ►  June ( 11 )
    • ►  May ( 11 )
    • ►  April ( 8 )
    • ►  March ( 10 )
    • ►  February ( 2 )
    • ►  January ( 2 )
  • ►  2022 ( 133 )
    • ►  December ( 16 )
    • ►  November ( 5 )
    • ►  October ( 7 )
    • ►  September ( 8 )
    • ►  August ( 14 )
    • ►  July ( 29 )
    • ►  June ( 18 )
    • ►  May ( 16 )
    • ►  April ( 9 )
    • ►  March ( 7 )
    • ►  February ( 2 )
    • ►  January ( 2 )
  • ►  2021 ( 90 )
    • ►  December ( 2 )
    • ►  November ( 1 )
    • ►  August ( 7 )
    • ►  July ( 4 )
    • ►  June ( 33 )
    • ►  May ( 10 )
    • ►  April ( 5 )
    • ►  March ( 8 )
    • ►  February ( 5 )
    • ►  January ( 15 )
  • ►  2020 ( 229 )
    • ►  December ( 39 )
    • ►  November ( 12 )
    • ►  October ( 10 )
    • ►  September ( 14 )
    • ►  August ( 10 )
    • ►  July ( 21 )
    • ►  June ( 18 )
    • ►  May ( 14 )
    • ►  April ( 14 )
    • ►  March ( 26 )
    • ►  February ( 20 )
    • ►  January ( 31 )
  • ►  2019 ( 256 )
    • ►  December ( 19 )
    • ►  November ( 17 )
    • ►  October ( 67 )
    • ►  September ( 17 )
    • ►  August ( 19 )
    • ►  July ( 15 )
    • ►  June ( 40 )
    • ►  May ( 27 )
    • ►  April ( 11 )
    • ►  March ( 3 )
    • ►  February ( 1 )
    • ►  January ( 20 )
  • ►  2018 ( 133 )
    • ►  December ( 17 )
    • ►  October ( 1 )
    • ►  September ( 1 )
    • ►  August ( 2 )
    • ►  July ( 4 )
    • ►  June ( 12 )
    • ►  May ( 9 )
    • ►  April ( 29 )
    • ►  March ( 10 )
    • ►  February ( 23 )
    • ►  January ( 25 )
  • ►  2017 ( 275 )
    • ►  December ( 24 )
    • ►  November ( 9 )
    • ►  October ( 25 )
    • ►  September ( 28 )
    • ►  August ( 4 )
    • ►  July ( 8 )
    • ►  June ( 5 )
    • ►  May ( 20 )
    • ►  April ( 35 )
    • ►  March ( 57 )
    • ►  February ( 37 )
    • ►  January ( 23 )
  • ►  2016 ( 90 )
    • ►  December ( 2 )
    • ►  November ( 4 )
    • ►  October ( 13 )
    • ►  September ( 24 )
    • ►  August ( 14 )
    • ►  June ( 11 )
    • ►  May ( 6 )
    • ►  April ( 3 )
    • ►  March ( 9 )
    • ►  February ( 4 )
  • ►  2015 ( 36 )
    • ►  December ( 2 )
    • ►  November ( 1 )
    • ►  October ( 4 )
    • ►  September ( 2 )
    • ►  July ( 3 )
    • ►  May ( 2 )
    • ►  April ( 1 )
    • ►  March ( 4 )
    • ►  February ( 9 )
    • ►  January ( 8 )
  • ►  2014 ( 201 )
    • ►  December ( 1 )
    • ►  November ( 8 )
    • ►  October ( 12 )
    • ►  September ( 11 )
    • ►  August ( 12 )
    • ►  July ( 19 )
    • ►  June ( 22 )
    • ►  May ( 11 )
    • ►  April ( 27 )
    • ►  March ( 46 )
    • ►  February ( 24 )
    • ►  January ( 8 )
  • ►  2013 ( 77 )
    • ►  December ( 39 )
    • ►  October ( 4 )
    • ►  September ( 2 )
    • ►  August ( 9 )
    • ►  July ( 5 )
    • ►  June ( 3 )
    • ►  May ( 4 )
    • ►  April ( 5 )
    • ►  March ( 3 )
    • ►  February ( 3 )
  • ►  2012 ( 35 )
    • ►  December ( 14 )
    • ►  November ( 2 )
    • ►  September ( 7 )
    • ►  August ( 4 )
    • ►  July ( 8 )
Copyright © 2025. All rights reserved. Theme images by Ollustrator. Powered by Blogger.