big data processing -凯发k8网页登录
mapreduce
,
on spark® and hadoop® clustersyou can use parallel computing toolbox™ to distribute large arrays in parallel across multiple matlab® workers, so
that you can run big-data applications that use the combined memory of your cluster. you
operate on the entire array as a single entity, however, workers operate only on their part of
the array, and automatically transfer data between themselves when necessary. parallel computing toolbox also enables you to execute matlab® tall array and datastore
calculations in parallel, so that
you can analyze big data sets that do not fit in the memory of your cluster. you can use
matlab
parallel server™ to run tall array and datastore
calculations in parallel on
spark enabled hadoop clusters. doing so significantly reduces the execution time of very large
data calculations.
categories
analyze big data sets in parallel using distributed arrays and simultaneous execution
analyze big data sets in parallel using matlab tall arrays and datastores ormapreduce
on spark and hadoop clusters, and parallel pools