返回
Building extensible frameworks for data processing: The case of MDP, Modular toolkit for Data Processing
DOI:10.1016/j.jocs.2011.10.005.png)
摘要
En 中文
Data processing is a ubiquitous task in scientific research, and much energy is spent on the development of appropriate algorithms. It is thus relatively easy to find software implementations of the most common methods. On the other hand, when building concrete applications, developers are often confronted with several additional chores that need to be carried out beside the individual processing steps. These include for example training and executing a sequence of several algorithms, writing code that can be executed in parallel on several processors, or producing a visual description of the application. The Modular toolkit for Data Processing (MDP) is an open source Python library that provides an implementation of several widespread algorithms and offers a unified framework to combine them to build more complex data processing architectures. In this paper we concentrate on some of the newer features of MOP, focusing on the choices made to automatize repetitive tasks for users and developers. In particular, we describe the support for parallel computing and how this is implemented via a flexible extension mechanism. We also briefly discuss the support for algorithms that require bi-directional data flow. (C) 2011 Elsevier B.V. All rights reserved.
Keyword:
Machine learning
Python
Scientific computing
Computational neuroscience
期刊
IF:
18.3
论文数:
3.1K
被引数:
4.0K
机构
引用论文
Two-dimensional bricklayer arrangements of tolans using halogen bonding interactions使用卤素键相互作用的tolans的二维瓦工层布置
A multiplatform code for the analysis of energy-dispersive X-ray fluorescence spectra用于分析能量色散x射线荧光光谱的多平台代码

