Table of Contents

DataSet

An associative data container

Sound Into Sound Exploring the Oboe with FluCoMa Levels of Translation Interface Design with FluCoMa Batch Processing with FluCoMa Neural Network Training Comparing Scalers Distribution and Histograms Outliers Smoothing Data BufFlatten DataSetQuery Grid KDTree KNNClassifier KNNRegressor LabelSet MDS MLPClassifier MLPRegressor Normalize PCA Plotter RobustScale Standardize

The DataSet is an important object in the second FluCoMa toolbox. Whenever there is a need to create a collection of data (such as for input to a machine learning process), or to make a provision for some output, DataSet is the tool that you’ll want to reach for.

The DataSet starts out empty and we add any number of points to it. A point is made up of two bits of information: an identifier and some data. The data is any number of numerical bits of information stored in a buffer. The identifier is a string or symbol which is associated to the data. If you have used the coll, dict, text or Dictionary objects in your environment of choice you will already be familiar with this idea of storing data associatively. If you’re not, you can think of it like a filing system. The identifier gives us a human-readable bit of information which we can use to look up the data that it is attached to.

A small DataSet is depicted below, with 5 points. Each identifier is an instrument name, and we might imagine the data associated to each of these identifiers could be descriptor values or parameters for example.

DataSet

Identifier
Data
guitar
0.39
0.58
0.82
0.82
0.06
synth
0.06
0.90
0.54
0.59
0.98
trombone
0.51
0.22
0.80
0.38
0.91
saxophone
0.22
0.81
0.40
0.17
0.81
noise
0.94
0.70
0.32
0.09
0.53

Some Caveats to Remember

  1. For each point, the data needs to be uniformly sized. In other words, if the first point you add to a DataSet dictates how many numbers each point’s data can should have. If you added a point that had 10 numbers in the data, and then tried to add a new point with 3 numbers in the data it wouldn’t work.

  2. Identifiers are unique. You cannot have the same identifier twice in a single DataSet.

  3. When data is transformed and passed between many instances of FluCoMa objects, the identifiers are preserved meaning one can backtrack results from the end to the beginning of a processing pipeline.

Usage

The help files in each environment are the best place to see the most common usage of the DataSet including adding, updating and deleting points.