About: I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data

Not logged in : Login

(Sponging disallowed)

Facets (new session)
Description
Metadata
Settings
- Rule:
- Inverse Functional Properties:
- "Same As":

About: I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data Goto Sponge NotDistinct Permalink

An Entity of Type : bibo:AcademicArticle, within Data Space : demo.openlinksw.com associated with source document(s)

Attributes	Values
type	http://eprints.org/ontology/ArticleEPrint http://eprints.org/ontology/EPrint Article Academic Article
seeAlso	HTML Summary of #84806 I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data
sameAs	I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data
http://eprints.org/ontology/hasAccepted	I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data (PDF)
http://eprints.org/ontology/hasDocument	I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data (PDF) I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data (Other) I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data (Other) I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data (Other) I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data (Other) I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data (Other)
dc:hasVersion	I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data (PDF)
Title	I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data
described by	https://demo.openlinksw.com/about/id/entity/https/www.cs.kent.ac.uk/people/staff/akj22/materials/CO644/export_kar_RDFN3.n3
Date	2020
Creator	Chloe Callahan-Flintoft John Collins William Jones Brad Wyble Michael Powell Howard Bowman Mahan Hosseini
status	peer reviewed published
Publisher	Elsevier
abstract	Machine learning has enhanced the abilities of neuroscientists to interpret information collected through EEG, fMRI, and MEG data. With these powerful techniques comes the danger of overfitting of hyperparameters which can render results invalid. We refer to this problem as ‘overhyping’ and show that it is pernicious despite commonly used precautions. Overhyping occurs when analysis decisions are made after observing analysis outcomes and can produce results that are partially or even completely spurious. It is commonly assumed that cross-validation is an effective protection against overfitting or overhyping, but this is not actually true. In this article, we show that spurious results can be obtained on random data by modifying hyperparameters in seemingly innocuous ways, despite the use of cross-validation. We recommend a number of techniques for limiting overhyping, such as lock boxes, blind analyses, pre-registrations, and nested cross-validation. These techniques, are common in other fields that use machine learning, including computer science and physics. Adopting similar safeguards is critical for ensuring the robustness of machine-learning techniques in the neurosciences.
Is Part Of	Neuroscience & Biobehavioral Reviews https://kar.kent.ac.uk/id/repository
Subject	Q Science
list of authors	https://kar.kent.ac.uk/id/eprint/84806#authors
volume	119
is topic of	https://www.cs.kent.ac.uk/people/staff/akj22/materials/CO644/export_kar_RDFN3.n3
is primary topic of	HTML Summary of #84806 I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data

Faceted Search & Find service v1.17_git144 as of Jul 26 2024

Alternative Linked Data Documents: iSPARQL | ODE Content Formats:

RDF

ODATA

Microdata

About

OpenLink Virtuoso version 08.03.3331 as of Aug 25 2024, on Linux (x86_64-ubuntu_noble-linux-glibc2.38-64), Single-Server Edition (378 GB total memory, 48 GB memory in use)
Data on this page belongs to its respective rights holders.
Virtuoso Faceted Browser Copyright © 2009-2024 OpenLink Software