package parany
Install
Dune Dependency
Authors
Maintainers
Sources
sha256=00a63674b3248f6a04dab20518c4afeefafeeb8525a5bb7035ba4514608e0006
md5=f8af0fbac532e4aa7cf382f13daa8a52
Description
Generalized map reduce for parallel computers (not distributed computing). Can process in parallel an infinite stream of elements.
Can process a very large file in parallel on a multicore computer; provided there is a way to cut your file into independent blocks (the 'demux' function). The processing function is called 'work'. The function gathering the results is called 'mux'. The chunk size (number of items) processed by one call to the 'work' function is called 'csize'.
There is a minimalist Parmap module, if you want to switch to/from Parmap easily.
Read the corresponding ocamldoc before using.
Published: 06 Jan 2023
README
parany
Parallelize any kind of computation
Generalized map reduce for parallel computers (not distributed computing).
Can process a very large file in parallel on a multi-core computer; provided there is a way to cut your file into independent blocks (the "demux" function).
Can process in parallel an infinite stream of elements (if you don't care about their processing order). In practice, if the stream is really infinite but you want to collect results in order, some integer counter will eventually overflow and the behavior is unspecified and unknown after this unfortunate event.
The processing function is called "work". The function gathering the results is called "mux".
Dependencies (3)
-
ocaml
>= "5.0.0"
-
dune
>= "1.6.0"
-
domainslib
>= "0.5.0"
Dev Dependencies
None
Used by (14)
- acp4
-
acpc
>= "2.0.0"
- comby
-
hts_shrink
>= "2.1.2"
-
lbvs_consent
>= "2.2.0"
-
linwrap
>= "5.1.1"
-
molenc
>= "11.4.0"
-
oplsr
>= "8.0.1"
-
oranger
>= "3.0.1"
- orf
-
orrandomForest
>= "3.0.0"
-
pardi
>= "3.1.1"
-
rankers
>= "2.0.9"
- svmwrap
Conflicts
None