Evaluation Workshop of the first CAMI Challenge
| Created: | 2016-05-13 16:39 |
|---|---|
| Institution: | Isaac Newton Institute for Mathematical Sciences |
| Description: | Critical Assessment of Metagenome Interpretation (CAMI)
The interpretation of metagenomes relies on sophisticated computational approaches, such as short read assembly, binning and taxonomic classification. All subsequent analyses can only be as meaningful as the outcome of these initial data processing methods. Tremendous progress has been achieved during the last years. However, none of these approaches can completely recover the complex information encoded in metagenomes. Simplifying assumptions are needed and lead to strong limitations and potential inaccuracies in their practical use. The accuracy of computational methods in metagenomics has so far been evaluated in publications presenting novel or improved methods. However, these snapshots are hardly comparable due to the lack of a general standard for the assessment of computational methods in metagenomics. Users are thus not well informed about general and specific limitations of computational methods. This may result in misinterpretations of computational predictions. Furthermore, method developers need to individually evaluate existing approaches in order to come up with ideas and concepts for improvements and new algorithms. This consumes substantial time and computational resources, and may introduce unintended biases. We suggest tackling this problem by a new initiative, aiming at the “Critical Assessment of Metagenome Interpretation” (CAMI). It should evaluate methods in metagenomics independently, comprehensively and without bias. The initiative should supply users with exhaustive quantitative data about the performance of methods in all relevant scenarios. It will therefore guide users in the selection and application of methods and in their proper interpretation. Furthermore, it will provide valuable information to developers, allowing them to identify promising directions for their future work. The first CAMI challenge took part in 2015. In the evaluation workshop of the first CAMI challenge at the INI, the challenge results will be analyzed and discussed with participating developer teams. In addition, the focus of future CAMI challenges will be discussed. All talks will be streamed. Interested scientists are encouraged to join. |
| Website: | http://cami-challenge.org |
Media items
This collection contains 12 media items.
Media items
A framework for the continuous Assessment of Metagenome Interpretation
Belmann, P (Universität Bielefeld)
Wednesday 11th May 2016 - 11:00 to 11:45
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
An overview of the assembly results
Sczyrba, A (Universität Bielefeld)
Wednesday 11th May 2016 - 11:45 to 12:30
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
An overview of the binning results
McHardy, A (Helmholtz Centre for Infection Research)
Wednesday 11th May 2016 - 13:30 to 14:15
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Mon 23 May 2016
An overview of the profiling results
Koslicki, D (Oregon State University)
Wednesday 11th May 2016 - 14:15 to 15:00
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
CAMI challenge data & simulation pipeline
Bremges, A (Helmholtz Centre for Infection Research)
Wednesday 11th May 2016 - 09:45 to 10:30
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
Challenges in pathogen detection with metagenome classification techniques
Treangen,T
Thursday 12th May 2016 - 15:30 to 16:00
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
Computational Infrastructure to Support CAMI
Blood, P (Carnegie Mellon University, University of Pittsburgh)
Thursday 12th May 2016 - 11:20 to 11:35
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
Establishing benchmark data sets for further development of unsupervised binning tools
Wu, Y (University of California)
Thursday 12th May 2016 - 10:50 to 11:20
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Wed 18 May 2016
Future focus of CAMI challenges
McHardy, A (Helmholtz Centre for Infection Research)
Sczyrba, A (Universität Bielefeld)
Thursday 12th May 2016 - 09:00 to 09:20
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
Introduction
McHardy, A (Helmholtz Centre for Infection Research )
Wednesday 11th May 2016 - 09:30 to 09:45
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
Long-read and hybrid metagenomic assembly: tradeoffs and detections limits
Nagarajan, N (Genome Institute of Singapore)
Thursday 12th May 2016 - 09:50 to 10:20
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016
Resolving genomes from metagenomic strain mixtures with 3C & Hi-C. Is it possible?
Darling, A (University of Technology Sydney)
Thursday 12th May 2016 - 09:20 to 09:50
Collection: Evaluation Workshop of the first CAMI Challenge
Institution: Isaac Newton Institute for Mathematical Sciences
Created: Fri 13 May 2016