A language and runtime for distributed, incremental data processing in the cloud
Highlights from this release:
Fix file descriptor leak in ReflowRunner.
Highlights from this release
start
and end
options to the reflow logs
command.Notable features:
Dir comprehensions yield (path, file) pairs. For example, after running:
d := dir("/home/notes")
result := [ strings.Join([path, "has", strings.FromInt(len(f)), "bytes"], " ") | (path, f) <- d, if strings.HasSuffix(path, ".txt") ]
result contains a list of strings based on the files in /home/notes with the ".txt" extension, such as:
["foo.txt has 725 bytes", "bar.txt has 89 bytes", "zoo.txt has 7061 bytes"]
For improved performance, please use dir comprehensions in places where a dir was previously converted to a list or map. For example, it is generally recommended to replace:
[ (name, f) | (name, f) < list(someDir)]
and
[ (name, f) | (name, f) < map(someDir)]
with
[ (name, f) | (name, f) < someDir]
Highlights from this release:
Highlights from this release:
dir
summation code to take advantage of these improvementsChange this: dirs.Make(map([(fooPath, fooFile)] + list(otherDir)))
to this: dirs.Make(map([(fooPath, fooFile)])) + otherDir
reflow info
output now includes the error message for failed execs, see reflow info -help
for more infoHighlights from this release:
-gc
and -sched
are no longer used and have been removedNVMe
, intel_avx512
, intel_turbo
are now correctly reported for various EC2 instance typesHighlights from this release:
reflow ec2instances
tool, including an option to show spot placement scores by AZ