3 * --memsuspend suspends jobs when there is little memory free. This
4 way you can run jobs in parallel that added up potentially will take
5 up more RAM than is available.
7 * $PARALLEL_ARGHOSTGROUPS and the replacement string {agrp} will give
8 the hostgroup given on the argument when using --hostgroup.
10 * Handy time functions for {= =}: yyyy_mm_dd_hh_mm_ss()
11 yyyy_mm_dd_hh_mm() yyyy_mm_dd() yyyymmddhhmmss() yyyymmddhhmm()
14 * Bug fixes and man page updates.
16 News about GNU Parallel:
18 * Software Engineering For Scientists
19 https://canvas.stanford.edu/courses/133091
21 * Optional Individual Submission 4 Job Handling - GNU Parallel
22 https://www.youtube.com/watch?v=-tX0bFAYAxM
24 * 关于gnu parallel:GnuParallel:在集群上并行化脚本,脚本将文件写入主
25 节点https://www.codenong.com/25172209/
28 https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
33 * --pipe engine changed making --pipe alpha quality.
35 * --results -.json outputs results as JSON objects on stdout (standard
38 * --delay 123auto will auto-adjust --delay. If jobs fail due to being
39 spawned too quickly, --delay will exponentially increase.
41 * --plus sets {hgrp} that gives the intersection of the hostgroups of
42 the job and the sshlogin that the job is run on.
44 * Bug fixes and man page updates.
46 News about GNU Parallel:
48 * Best practices for accelerating data migrations using AWS Snowball
50 https://aws.amazon.com/blogs/storage/best-practices-for-accelerating-data-migrations-using-aws-snowball-edge/
52 * Pass the Output of a Command as an Argument for Another
53 https://www.baeldung.com/linux/pass-cmd-output-as-an-argument
55 * Warwick RSE Drop-in - Workflow Management Part 2 - GNU Parallel
56 https://www.youtube.com/watch?v=t_v2Otgt87g
61 * Bug fixes and man page updates.
63 News about GNU Parallel:
65 * https://bash-prompt.net/guides/gnu-parallel-multi-server/
70 * --termseq now works for jobs running remotely.
72 * parsort: Performance optimized for 64-core machines.
74 * Bug fixes and man page updates.
76 News about GNU Parallel:
78 * Juan Sierra Pons has made a testimonial:
79 http://www.elsotanillo.net/wp-content/uploads/GnuParallel_JuanSierraPons.mp4
81 * 「翻译」在生物信息学中使用 GNU-Parallel
82 https://cloud.tencent.com/developer/article/1705499
87 * New CPU detection for GNU/Linux.
89 * Bug fixes and man page updates.
91 News about GNU Parallel:
93 * Aug 21, 2020 - More Unix tools
94 https://floki.blog/2020/08/more_unix_tools
101 * Max command line length is changed for MacOS - making this version
102 beta quality for MacOS.
104 * Bug fixes and man page updates.
111 * No new functionality
113 * Bug fixes and man page updates.
115 News about GNU Parallel:
117 * Tips for Running Jobs on your VM
118 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
120 * Introduction to GNU Parallel: Parallelizing Massive Individual Tasks
121 https://www.youtube.com/watch?v=QSFLTEyCKvo
124 http://www.hpc.lsu.edu/training/weekly-materials/2020-Spring/GNUParallel_Spring_2020.pdf
126 * Linux-Fu: Parallel Universe
127 https://hackaday.com/2020/06/29/linux-fu-parallel-universe/
129 * Resumable batch jobs with gnu parallel https://igor.io/parallel/
131 * Introducing Parallel into Shell
132 https://www.petelawson.com/post/parallel-in-shell/
134 * AV1 encoding parallelization with GNU Parallel
135 https://www.reddit.com/r/AV1/comments/fjvqp9/av1_encoding_parallelization_with_gnu_parallel/
137 * Beschleunigte Befehlsbearbeitung mit GNU Parallel
138 https://www.linux-community.de/ausgaben/linuxuser/2013/06/beschleunigte-befehlsbearbeitung-mit-gnu-parallel/
145 * No new functionality
147 * Bug fixes and man page updates.
149 News about GNU Parallel:
151 * GNU Parallel is used at NERSC:
152 https://www.nersc.gov/assets/Uploads/08-Workflows-20200616.pdf
154 * Resumable batch jobs with GNU Parallel https://igor.io/parallel/
156 * Lab Meeting technical talk
157 https://www.slideshare.net/hoffmanlab/gnu-parallel-194030490
159 * Open Sky Software Website Credits
160 https://www.openskysoftware.com/site-credits.htm
162 * Speed up your Python Scripts using Ubuntu and GNU Parallel
163 https://ecce.esri.ca/wpecce/2019/12/24/speed-up-your-python-scripts-using-ubuntu-and-gnu-parallel/
165 * Indispensable command-line tools
166 https://negfeedback.blogspot.com/2020/05/indispensable-command-line-tools.html
168 * GNU Parallel for simulations
169 http://pdebuyl.be/blog/2020/gnu-parallel-for-simulations.html
171 * Introduction to GNU parallel
172 https://bioinformaticsworkbook.org/Appendix/GNUparallel/GNU_parallel_examples.html
179 * While running a job $PARALLEL_JOBSLOT is the jobslot of the job. It
180 is equal to {%} unless the job is being retried. See {%} for
183 * While running a job $PARALLEL_SSHLOGIN is the sshlogin line with
184 number of cores removed. E.g. '4//usr/bin/specialssh user@host'
185 becomes: '/usr/bin/specialssh user@host'
187 * While running a job $PARALLEL_SSHHOST is the host part of an
188 sshlogin line. E.g. '4//usr/bin/specialssh user@host' becomes:
191 * --plus activates the replacement strings {slot} = $PARALLEL_JOBSLOT,
192 {sshlogin} = $PARALLEL_SSHLOGIN, {host} = $PARALLEL_SSHHOST
194 * Bug fixes and man page updates.
196 News about GNU Parallel:
198 * Portable Batch System (PBS) & GNU Parallel - Running a Program
199 Multiple Times in Parallel
200 https://www.youtube.com/watch?v=6ccbWu6Befo
202 * GNU Parallel przykład https://www.youtube.com/watch?v=gs_wG4Kt2G4
204 * Demo of LINUX APP - GNU PARALLEL - running multiple Gstreamer webcam
205 .sh scripts with only 1 command
206 https://www.youtube.com/watch?v=trQuA_wmWjg
211 This release celebrates GNU Parallel's 10 years as a GNU tool:
213 > commit ed2dfb1043768154d4e7678e01e10287155fa834
214 > Author: Ole Tange <ole@tange.dk>
215 > Date: Thu Apr 22 01:23:00 2010 +0200
217 > Name change: Parallel is now GNU Parallel.
218 > Basic structure for sshlogin and sshloginfile.
222 * parsort makes GNU sort run faster for files with more than 1M lines.
224 * Bug fixes and man page updates.
226 News about GNU Parallel:
228 * Several clusters have updated their documentation of GNU Parallel:
229 https://www.grid5000.fr/w/GNU_Parallel
230 https://research-it.berkeley.edu/virtual-training-running-jobs-parallel-savio
231 http://www.hpc.lsu.edu/training/archive/tutorials.php
233 * add_pho uses GNU Parallel: https://github.com/SeedlingsBabylab/add_pho
235 * GNU parallel使用笔记https://zhuanlan.zhihu.com/p/37340011
237 * Virtual Workshop: Running Jobs in Parallel on Savio
238 https://ais.berkeley.edu/events/virtual-workshop-running-jobs-parallel-savio/2020-04-20
240 * Free Concurrency with GNU Parallel
241 https://phili.pe/posts/free-concurrency-with-gnu-parallel/
246 * Bug fixes and man page updates.
248 News about GNU Parallel:
250 * The GNU Parallel course in Copenhagen is cancelled
251 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
253 * The GNU Parallel course in Århus is cancelled
254 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
256 * The 10 year anniversary may be cancelled, see
257 https://www.gnu.org/software/parallel/10-years-anniversary.html
259 * Running shell commands in parallel, via GNU Parallel
260 https://dev.to/saveriomiroddi/running-shell-commands-in-parallel-via-gnu-parallel-3a72
262 * Faster nmap scanning with the help of GNU parallel
263 https://badshah.io/experiment/faster-nmap-scanning-with-the-help-of-gnu-parallel/
268 * Bug fixes and man page updates.
273 * --blocktimeout dur - Time out for reading block when using
274 --pipe. If it takes longer than dur to read a full block, use the
275 partial block read so far.
277 * Bug fixes and man page updates.
279 News about GNU Parallel:
281 * GNU Parallel course in Copenhagen
282 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
284 * GNU Parallel course in Århus
285 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
287 * GNU Parallel pour accélérer vos process sous Linux
288 https://www.yvonh.com/gnu-parallel-pour-accelerer-vos-process-sous-linux/
290 * How to copy a file to multiple directories in Linux
291 https://net2.com/how-to-copy-a-file-to-multiple-directories-in-linux/
293 * Running linux commands in parallel https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8
298 * GNU Parallel course in Copenhagen
299 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
301 * GNU Parallel course in Århus
302 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
304 * GNU Parallel is used in
305 https://github.com/JeffersonLab/rfw_tsf_extractor
307 * Bug fixes and man page updates.
312 * GNU Parallel was presented at Driving IT. Slides:
313 cloud.prosa.dk/s/drivingit
315 * Restarting supervisord processes in parallel
316 https://blog.naderman.de/2019/11/14/restarting-supervisord-processes-in-parallel/
318 * Using GNU Parallel to Create Archives Faster
319 https://www.reddit.com/r/DataHoarder/comments/dsgmhc/parallel_archiving_techniques/
321 * Bug fixes and man page updates.
326 * --tee will use --output-error=warn-nopipe if supported by tee.
328 * GNU Parallel will be presented at Driving IT 2019:
329 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools
331 * UMN Duluth: Job parallelization with task arrays and GNU parallel
332 https://www.msi.umn.edu/tutorials/umn-duluth-job-parallelization-task-arrays-and-gnu-parallel
334 * Genome updater uses GNU Parallel
335 https://github.com/pirovc/genome_updater
337 * Using GNU-Parallel for bioinformatics
338 https://www.danielecook.com/using-gnu-parallel-for-bioinformatics/
340 * Speeding up PostgreSQL ETL pipeline with the help of GODS
341 https://cfengine.com/company/blog-detail/speeding-up-postgresql-etl-pipeline-with-the-help-of-gods/
343 * Runing linux commands in parallel
344 https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8
346 * Research Computing University of Colorado Boulder contains an intro
348 https://readthedocs.org/projects/curc/downloads/pdf/latest/
350 * 如何使用Parallel在Shell中并行执行命令
351 https://www.myfreax.com/gnu-parallel/
353 * 如何测试 Amazon Elastic File System
354 https://aws.amazon.com/cn/blogs/china/how-to-test-drive-amazon-elastic-file-system/
356 * Bug fixes and man page updates.
361 * --nice is now inherited by the nice level that GNU Parallel is
362 started at. So 'nice -n10 parallel' will also cause remote jobs to
363 be run at nice level 10.
365 * --delay is now accurate to within 10 ms
367 * GNU Parallel will be presented at Driving IT 2019:
368 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools
370 * Greenland Ice Sheet solid ice discharge from 1986 through 2017
371 https://www.earth-syst-sci-data.net/11/769/2019/essd-11-769-2019.pdf
373 * App Center Cloud Build Machines > Installed Software > Utilities
374 https://docs.microsoft.com/en-us/appcenter/build/software
376 * Curryfinger - SNI & Host header spoofing utility
377 https://dualuse.io/blog/curryfinger/
380 https://wiki.cac.washington.edu/display/hyakusers/Hyak+parallel-sql
382 * A meditation on analysing data with Perl in parallel using GNU Parallel
383 https://www.reddit.com/r/perl/comments/cyo2qc/a_meditation_on_analysing_data_with_perl_in/
385 * Accélérer ses tâches avec GNU Parallel et les lots de tâches (UL)
386 https://www.eventbrite.ca/e/inscription-accelerer-ses-taches-avec-gnu-parallel-et-les-lots-de-taches-ul-71412840729
388 * RMACC Summit GNU Parallel
389 https://curc.readthedocs.io/en/latest/software/GNUParallel.html
391 * Introducing Parallel into Shell
392 https://petelawson.com/post/parallel-in-shell/
394 * Linux Productivity Tools
395 https://www.usenix.org/conference/lisa19/presentation/maheshwari
397 * Gnu/parallel + Nfs 实现共享文件网络的并发计算等操作
398 http://atomicer.cn/2018/01/18/gnu-parallel-nfs-%E5%AE%9E%E7%8E%B0%E5%85%B1%E4%BA%AB%E6%96%87%E4%BB%B6%E7%BD%91%E7%BB%9C%E7%9A%84%E5%B9%B6%E5%8F%91%E8%AE%A1%E7%AE%97%E7%AD%89%E6%93%8D%E4%BD%9C/#more
400 * Bug fixes and man page updates.
405 * GNU Parallel will be presented at Driving IT 2019:
406 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it#beskrivelse
408 * Linux Productivity Tools
409 https://www.usenix.org/conference/lisa19/presentation/maheshwari
411 * Improve your reconnaissance performance by using GNU Parallel
412 https://mailchi.mp/3f46ceb46357/improve-your-reconnaissance-performance-by-using-gnu-parallel
414 * Paralel İşler / İşlemler / Programlar Bash’de Nasıl Çalıştırılır?
415 https://kaleinfo.com/2019/07/29/paralel-isler-islemler-programlar-bashde-nasil-calistirilir-2/
417 * Use POLYBAR to change WALLPAPER with GNU Parallel
418 https://www.youtube.com/watch?v=rjYg-b_eiRU
420 * Finding the Balance Between Speed & Accuracy During an Internet-wide
422 https://captmeelo.com/pentest/2019/07/29/port-scanning.html
424 * GNU Parallel Ryugu released
425 https://linuxreviews.org/GNU_Parallel_Ryugu_released
427 * CO2017 - CW1 - Operating Systems & Networks - Shell scripting
428 http://www.7daixie.com/2019071646302396.html
430 * Bug fixes and man page updates.
435 * {= uq; =} causes the replacement string to be unquoted. Example:
436 parallel echo '{=uq;=}.jpg' ::: '*'
438 * --tagstring {=...=} is now evaluated for each line with --linebuffer.
440 * Use -J ./profile to read a profile in current dir.
442 * Speedup of startup by 40%: Find the parent shell differently on
443 GNU/Linux, cache information about the CPU and which setpgrp method
444 to use to make GNU Parallel start 40% faster.
446 * $PARALLEL_SSHLOGIN can be used in the command line.
448 * Occasionally sane: Simple usage of GNU parallel
449 https://vfoley.xyz/parallel/
451 * How to run multiple bash scripts in parallel
452 https://techieroop.com/how-to-run-multiple-bash-scripts-in-parallel/
454 * Announcing Oracle Solaris 11.4 SRU10
455 https://blogs.oracle.com/solaris/announcing-oracle-solaris-114-sru10
457 * Руководство по использованию GNU Parallel https://zalinux.ru/?p=2623
459 * Bug fixes and man page updates.
464 * --shard can now take a column name and optionally a perl
465 expression. Similar to --group-by and replacement strings.
467 * Using AWK and R to parse 25tb
468 https://livefreeordichotomize.com/2019/06/04/using_awk_and_r_to_parse_25tb/
470 * Parallel and Visual testing with Behat
471 http://parallelandvisualtestingwithbehat.blogspot.com/p/blog-page.html
473 * 维基百科,自由的百科全书https://zh.wikipedia.org/wiki/GNU_parallel
475 * Bug fixes and man page updates.
480 * --group-by groups lines depending on value of a column. The value
483 * How to compress (bzip / gzip) a very large text quickly?
484 https://medium.com/@gchandra/how-to-compress-bzip-gzip-a-very-large-text-quickly-27c11f4c6681
486 * Simple tutorial to install & use GNU Parallel
487 https://medium.com/@gchandra/simple-tutorial-to-install-use-gnu-parallel-79251120d618
489 * Introducing Parallel into Shell
490 https://petelawson.com/post/parallel-in-shell/
492 * Bug fixes and man page updates.
497 * Invitation to the 10 years anniversary next year.
499 * Bug fixes and man page updates.
504 * SIGTERM is changed to SIGHUP, so sending SIGHUP will make GNU
505 Parallel start no more jobs, but wait for running jobs to finish.
507 * SIGTERM SIGTERM is changed to SIGTERM, so sending SIGTERM will make
508 GNU Parallel kill all running jobs.
510 * GNU Parallel now includes a cheat sheet: parallel_cheat.pdf
512 * High Throughput Computing on RMACC Summit and Beyond
513 https://calendar.colorado.edu/event/high_throughput_computing_on_rmacc_summit_and_beyond#.XH2NBhB7mV4
515 * GNU Parallel Cheat Sheet by cpriest
516 https://www.cheatography.com/cpriest/cheat-sheets/gnu-parallel/
518 * Use Multiple CPU Cores(Parallelize) with Single Threaded Linux
520 http://xensoft.com/use-multiple-cpu-cores-parallelize-with-single-threaded-linux-commands/
522 * Bug fixes and man page updates.
527 * --shard makes it possible to send input to a the same jobslot based
528 on the value in one column of the input. It is similar to sharding
531 * --shellquote --shellquote will shell quote the input twice.
533 * GNU Parallel is available in Termux
534 https://github.com/termux/termux-packages/tree/master/packages/parallel
536 * Linux, command line & MetaCentrum
537 https://trapa.cz/sites/default/files/linux_bash_metacentrum_course_4.pdf
539 * How to supercharge your bash workflows with GNU parallel
540 https://medium.freecodecamp.org/how-to-supercharge-your-bash-workflows-with-gnu-parallel-53aab0aea141
542 * GNU Parallel Spring 2017 https://www.youtube.com/watch?v=LHb29uW_KyI
544 * Parallelizing Freesurfer blog.cogneurostats.com/?p=148
546 * FreeSurfer #4: Running recon-all in Parallel https://www.youtube.com/watch?v=XHN2tm3tNaw
548 * FreeSurfer: recon-all https://www.neurotrivial.com/2019/01/24/freesurfer-recon-all/
550 * Come ridimensionare 10k foto con la riga di comando
551 https://pigrecoinfinito.wordpress.com/2018/12/22/come-ridimensionare-10k-foto-con-la-riga-di-comando/
553 * 并行处理 – Gnu Parallel:嵌套并行
554 https://codeday.me/bug/20190122/552902.html
556 * シェルスクリプトでコマンドを並列実行する方法
557 https://www.kwbtblog.com/entry/2019/01/12/020423
559 * Bug fixes and man page updates.
564 * 'env_parallel --end-session' makes it possible to nest 'env_parallel
567 * Using GNU Parallel in pentesting https://youtu.be/mZ0OUJmkIlA?t=873
569 * Supercomputer Workshop: Feb 1&7
570 http://www.ece.unm.edu/featured-students/supercomputer-workshop-feb-17.html
572 * Bug fixes and man page updates.
577 * Better /proc/cpuinfo parser.
579 * Simpler job scheduling flow.
581 * MPGI Workshop: Job Parallelization with Task Arrays and GNU Parallel
582 https://www.msi.umn.edu/tutorials/mpgi-workshop-module-4
584 * CONCOCT uses GNU Parallel
585 https://media.readthedocs.org/pdf/concoct/latest/concoct.pdf
587 * If you use SLURM read
588 https://wiki.hpc.uconn.edu/index.php/Advanced_SLURM
591 https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
593 * Bug fixes and man page updates.
598 * Experimental simpler job flow control.
600 * 時間がかかるコマンドを GNU parallel で 並列実行する
601 https://qiita.com//grohiro/items/4db3fa951a4778c5c479
603 * Bug fixes and man page updates.
608 * env_parallel.fish: --session support (alpha quality)
610 * GNU Parallel was cited in: High-throughput sequencing of murine
611 immunoglobulin heavy chain repertoires using single side unique
612 molecular identifiers on an Ion Torrent PGM
613 https://doi.org/10.18632/oncotarget.25493
615 * GNU parallel in Japanese Wikipedia
616 https://ja.wikipedia.org/wiki/GNU_parallel
618 * Outils de paramétrisation des tâches: lots de tâches, GNU Parallel
619 https://www.eventbrite.ca/e/inscription-outils-de-parametrisation-des-taches-lots-de-taches-gnu-parallel-et-bqtools-midi-conference-de-50271076142
621 * Bug fixes and man page updates.
626 * Minix is supported again.
628 * Updated graph showing GNU Parallel's overhead per job for each
629 version. https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
631 * Intro to Computing at CARC includes introduction to GNU Parallel
632 http://carc.unm.edu/education--training/workshops-and-seminars.html
634 * Fast-GBS uses GNU Parallel https://bitbucket.org/jerlar73/fast-gbs/wiki/Home
636 * Belgium at 10 m resolution in July 2018 http://www.cesbio.ups-tlse.fr/multitemp/?p=14116
638 * Bug fixes and man page updates.
643 * parset sets exit code.
645 * How to install GNU Parallel
646 https://www.techrepublic.com/videos/how-to-install-gnu-parallel/
648 * Bug fixes and man page updates.
653 * The quoting engine has been changed. Instead of using \-quoting GNU
654 Parallel now uses '-quoting in bash/ash/dash/ksh. This should
655 improve compatibility with different locales. This is a big change
656 causing this release to be alpha quality.
658 * The CPU calculation has changed. By default GNU Parallel uses the
659 number of CPU threads as the number of CPUs. This can be changed to
660 the number of CPU cores or number of CPU sockets with
661 --use-cores-instead-of-threads or --use-sockets-instead-of-threads.
663 * The detected number of sockets, cores, and threads can be shown with
664 --number-of-sockets, --number-of-cores, and --number-of-threads.
666 * env_parallel now support mksh using env_parallel.mksh.
668 * GNU Parallel is distributed as part of Snippy
669 https://github.com/tseemann/snippy
671 * GNU Parallel: Ejecutar comandos simultáneamente en Linux
672 https://esgeeks.com/gnu-parallel-ejecutar-comandos-simultaneo-linux/
674 * Parallel download genomic data with GNU-Parallel
675 https://digibio.blogspot.com/search/label/GNU-Parallel
677 * Bug fixes and man page updates.
682 * Deal better with multibyte chars by forcing LC_ALL=C.
684 * GNU Parallel was introduced in Pincount Podcast:
685 https://pincountpodcast.com/episodes/29.html
687 * GNU Parallel was shown on Danish national news for 1.7 seconds: dr.dk
689 * How to run Linux commands simultaneously with GNU Parallel
690 https://www.techrepublic.com/article/how-to-run-commands-simultaneously-with-gnu-parallel/#ftag=RSS56d97e7
692 * Easy parallelization with GNU parallel
693 http://mpharrigan.com/2016/08/02/parallel.html
695 * GNU Parallel for mutlithreaded tasks
696 http://slhogle.github.io/2016/gnu-parallel/
698 * A GNU Parallel Clustering Demo
699 https://www.crowdsupply.com/ground-electronics/circumference/updates/a-gnu-parallel-clustering-demo
701 * 使用 GNU Parallel 提高 Linux 命令行执行效率
702 https://linux.cn/article-9718-1.html
704 * Ejecutando tareas desde consola simultáneamente con GNU Parallel
705 https://poesiabinaria.net/2018/06/ejecutando-tareas-desde-consola-simultaneamente-gnu-parallel/
707 * Cómo ejecutar varias tareas simultáneamente en el terminal con GNU
709 https://www.ubuntizando.com/como-ejecutar-varias-tareas-simultaneamente-en-el-terminal-con-gnu-parallel/
711 * GNU Parallel 활용 가이드 http://genoglobe.kr/kribb/gnu_parallel
713 * Bug fixes and man page updates.
718 * --tty allows for more programs accessing /dev/tty in parallel. Some
719 programs require tty access without using it.
721 * env_parallel --session will record names in current environment in
722 $PARALLEL_IGNORED_NAMES and exit. It is only used with env_parallel,
723 and can work like --record-env but in a single session.
725 * 35 day course: Linux shell scripting and text processing for big
726 data https://comquest.in/training
728 * How To Use Your Entire CPU In Bash With Parallel
729 https://bash-prompt.net/guides/parallell-bash/
731 * An easy way to run parallel jobs on Stampede2
732 https://blog.uta.edu/xus/2017/09/29/an-easy-way-to-run-parallel-jobs-on-stampede2/
734 * Get more done at the Linux command line with GNU Parallel
735 https://opensource.com/article/18/5/gnu-parallel
737 * Save Time with Modern Search Techniques
738 https://www.sans.org/summit-archives/file/summit-archive-1524582079.pdf
740 * GNU Parallel: haz más cosas simultáneamente en el terminal
741 https://blog.desdelinux.net/gnu-parallel-haz-mas-cosas-simultaneamente-en-el-terminal/
743 * 「今日から使い切る」ための GNU Parallelによる並列処理入門
744 https://www.slideshare.net/koji_matsuda/gnu-parallel
746 * Bug fixes and man page updates.
751 * --csv makes GNU Parallel parse the input sources as CSV. When used
752 with --pipe it only passes full CSV-records.
754 * Time in --bar is printed as 1d02h03m04s.
756 * Optimization of --tee: It spawns a process less per value.
758 * The GNU Parallel 2018 book is now available:
759 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html
761 * Modern pentest tricks for faster, wider, greater engagement (15)
762 https://conference.hitb.org/hitbsecconf2018ams/materials/D1%20COMMSEC%20-%20Thomas%20Debize%20-%20Modern%20Pentest%20Tricks%20for%20Faster,%20Wider,%20Greater%20Engagements.pdf
764 * Running many serial jobs efficiently
765 https://userinfo.surfsara.nl/documentation/running-many-serial-jobs-efficiently
767 * GNU Parallel: как сохранить результаты нескольких команд для
768 переменной? http://fliplinux.com/gnu-parallel-6.html
770 * Running Multiple Commands in Parallel on a GNU Linux
771 https://www.youtube.com/watch?v=sHpTywpb4_4
773 * Klaatu covers the documentation of GNU parallel in episode 12x15
774 http://gnuworldorder.info/
776 * Bug fixes and man page updates.
781 * niceload -p can now take multiple pids separated by comma
783 * --timeout gives a warning when killing processes
785 * --embed now uses the same code for all supported shells
787 * --delay can now take arguments like 1h12m07s
789 * Parallel. Straight from your command line
790 https://medium.com/@alonisser/parallel-straight-from-your-command-line-feb6db8b6cee
792 * GNU Parallel was used in POAP-Parallelized Open Babel & Autodock
793 suite Pipeline https://github.com/inpacdb/POAP
795 * Pi Cluster Parallel Script First Fire
796 https://chiefio.wordpress.com/2018/02/23/pi-cluster-parallel-script-first-fire/
798 * How to Restore MySQL Logical Backup at Maximum Speed
799 https://www.percona.com/blog/2018/02/22/restore-mysql-logical-backup-maximum-speed/
801 * Bug fixes and man page updates.
806 * --embed makes it possible to embed GNU parallel in a shell
807 script. This is useful if you need to distribute your script to
808 someone who does not want to install GNU parallel.
810 * Parallelize Your Large Batches of Small Jobs
811 https://amito.me/2018/02/Parallelize-Your-Large-Batches-of-Small-Jobs/
813 * Klaatu expounds upon xargs and talks GNU parallel in episode 12x6
814 http://gnuworldorder.info/
816 * How to use parallel to speed up your work
817 https://mike42.me/blog/how-to-use-parallel-to-speed-up-your-work
819 * Transient compute clustering with GNU Parallel and sshfs
820 https://dennismungai.wordpress.com/2018/02/06/transient-compute-clustering-with-gnu-parallel-and-sshfs/
822 * Useful Examples of ffmpeg and GNU parallel on the command-line
823 https://dennismungai.wordpress.com/2018/02/06/useful-examples-of-ffmpeg-and-gnu-parallel-on-the-command-line/
825 * Data Science at the Command Line (Chapter 8.3)
826 https://www.datascienceatthecommandline.com/
828 * Bug fixes and man page updates.
833 * bash / 병렬 https://code.i-harness.com/ko/docs/bash/2a1a
835 * 15分钟神器gnu parallel 入门观止
836 http://www.ezilin.com/2018/01/15gnu-parallel.html
838 * How To Run Multiple Commands In Parallel on Linux
839 https://www.slashroot.in/how-run-multiple-commands-parallel-linux
841 * Bug fixes and man page updates.
846 * env_parset for ash, dash, ksh, sh, zsh
848 * Automatically create hostgroups if argument ends in @sshlogin
850 * Tips for running jobs on your VM
851 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
853 * Node-local scheduling
854 https://mogonwiki.zdv.uni-mainz.de/dokuwiki/node_local_scheduling
856 * GNU Parallel https://docs.computecanada.ca/wiki/GNU_Parallel
858 * GNU Parallel のエラー処理 https://qiita.com/inouet/items/bfc208668c86caf8ff74
861 https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
863 * Bug fixes and man page updates.
868 * Using GNU Parallel to speed up Google Cloud Infrastructure
870 https://medium.com/@pczarkowski/using-gnu-parallel-to-speed-up-google-cloud-infrastructure-management-53e5c555ec05
872 * What is gnu parallel
873 http://wiki.chpc.ac.za/howto:bioinformatics:gnu-parallel
875 * Parallel, Scripts, Clusters, & Easy Use
876 https://chiefio.wordpress.com/2017/11/10/parallel-scripts-clusters-easy-use/
878 * Bug fixes and man page updates.
883 * Initial support for XDG Base Directory $XDG_* environment variables.
885 * Validating half a million TIFF files. Part
887 https://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
889 * Turing data science class: Cluster computing
890 https://www.turing.ac.uk/events/masterclass-cluster-computing/
892 * Butlin:Unix for Bioinformatics - advanced tutorial
893 https://openwetware.org/wiki/Butlin:Unix_for_Bioinformatics_-_advanced_tutorial
895 * พยายามใช้ CPU ให้ครบทุก CORE
896 https://veer66.wordpress.com/2017/09/02/use-multi-core/
898 * Examples on using GNU Parallel
899 https://gist.github.com/drmalex07/de8ff1379a560f6d84a0d863e60ae378
901 * Bug fixes and man page updates.
906 * Use '--limit myprog' to make a dynamic job limit. Just return 0 to
907 spawn another job, 1 to not spawn another job, and 2 to kill the
910 * PARALLEL_RSYNC_OPTS and --rsync-opts sets the options for rsync
913 * Download all of humble bundle books in parallel
914 https://til.hashrocket.com/posts/ggt1jaes4y-download-all-of-humble-bundle-books-in-parallel
916 * Bug fixes and man page updates.
921 * --line-buffer no longer uses tempfiles. This is faster and makes it
922 possible for a single process to output more data than there is free
925 * Vote for GNU Parallel's community ads on
926 http://meta.unix.stackexchange.com/a/4356/2972
927 http://meta.askubuntu.com/a/16750/22307
928 http://meta.serverfault.com/a/9040/45704
930 * Edit images with GNU Parallel and ImageMagick
931 https://fedoramagazine.org/edit-images-parallel-imagemagick/
933 * Running Bash Commands in Parallel
934 https://dzone.com/articles/running-bash-commands-in-parallel-1
936 * Today I Learned: GNU parallel, plate tectonics
937 https://medium.com/@nornagon/today-i-learned-gnu-parallel-plate-tectonics-9fcf24045e63
939 * GNU Parallel Tutorial
940 https://www.upf.edu/web/sct-sit/gnu-parallel-tutorial
942 * Validating half a million TIFF files
943 http://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
945 * Blender and GNU Parallel
946 https://www.blendernation.com/2017/08/16/blender-gnu-parallel/
948 * Quick Introduction to GNU Parallel
949 https://github.com/LangilleLab/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel
951 * A simple distributed animation render example using GNU Parallel
952 https://gitlab.com/skororu/scripts
954 * Do stuff on things, in parallel
955 http://blogs.fluidinfo.com/terry/2017/08/05/do-stuff-on-things-in-parallel/
957 * Bash And GNU Parallel NGS Bidniz
958 http://ino.pm/outreach/presentations/2014/03/genomics-wranglers/index.html
960 * Using for loop vs Gnu parallel for BLAST
961 http://www.ettemalab.org/using-for-loop-vs-gnu-parallel-for-blast/
963 * 并行rsync https://gxnotes.com/article/175866.html
965 * Bug fixes and man page updates.
970 * Vote for GNU Parallel's community ads on
971 http://meta.unix.stackexchange.com/a/4356/2972
972 http://meta.askubuntu.com/a/16750/22307
973 http://meta.serverfault.com/a/9040/45704
975 * GNU Parallel was cited in: Hayabusa: Simple and Fast Full-Text
976 Search Engine for Massive System Log Data
977 http://dl.acm.org/citation.cfm?id=3095788
979 * コマンドの並列化を行える『GNU parallel』の個人的使い方まとめ
980 https://orebibou.com/2017/07/%E3%82%B3%E3%83%9E%E3%83%B3%E3%83%89%E3%81%AE%E4%B8%A6%E5%88%97%E5%8C%96%E3%82%92%E8%A1%8C%E3%81%88%E3%82%8B%E3%80%8Egnu-parallel%E3%80%8F%E3%81%AE%E5%80%8B%E4%BA%BA%E7%9A%84%E4%BD%BF%E3%81%84/
982 * How to play and play with thousands of digitized 78rpm records
983 https://blog.archive.org/2017/07/10/how-to-play-and-play-with-78rpm-record-transfers/
985 * 并行一个for循环 https://gxnotes.com/article/130363.html
987 * RFC 8142: GeoJSON Text Sequences
988 https://sgillies.net/2017/05/18/rfc-8142-geojson-text-sequences.html
990 * Git auto fetch script I run every day
991 https://lukas.zapletalovi.com/2017/07/git-auto-fetch-script-i-run-every-day.html
993 * cores, cpus and threads
994 http://crazyhottommy.blogspot.de/2017/07/cores-cpus-and-threads.html
996 * Bug fixes and man page updates.
1001 * The command line can now contain \257 (Macron) or UTF characters
1004 * Vote for GNU Parallel's community ads on
1005 http://meta.unix.stackexchange.com/a/4356/2972
1006 http://meta.askubuntu.com/a/16750/22307
1007 http://meta.serverfault.com/a/9040/45704
1009 * Graph for overhead for 1000 jobs has been updated. It remains
1010 steadily at 3.5 ms per job on a 1.7 GHz machine
1011 https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
1013 * GNU Parallel was cited in: The topology of the directed clique
1014 complex as a network invariant
1015 https://springerplus.springeropen.com/articles/10.1186/s40064-016-2022-y
1017 * GNU Parallel was cited in: Improving Optical Character Recognition
1018 of Finnish Historical Newspapers with a Combination of Fraktur &
1019 Antiqua Models and Image
1020 http://www.ep.liu.se/ecp/131/038/ecp17131038.pdf
1022 * GNU Parallel was cited in: Parallel Execution of Structural Mechanic
1023 Tasks with Use of Small Supercomputers
1024 http://www.sciencedirect.com/science/article/pii/S1877705817324815
1026 * GNU Parallel was cited in: Integration of a Multilingual Preordering
1027 Component into a Commercial SMT Platform
1028 https://www.degruyter.com/downloadpdf/j/pralin.2017.108.issue-1/pralin-2017-0009/pralin-2017-0009.pdf
1030 * Tips For Running Jobs On Your VM
1031 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
1033 * Speed up ML model development with GNU Parallel
1034 https://pzelasko.github.io/posts/speed-up-ml-model-development-with-gnu-parallel
1036 * Parallelizing a Python Function for the Extremely Lazy
1037 http://tdhopper.com/blog/2017/Jun/07/parallelizing-a-python-function-for-the-extremely-lazy/
1040 http://www.android5.online/Android/androidjc/androidkf/gykf/201603/8741.html
1042 * Bug fixes and man page updates.
1047 * --timeout can now use s=second,m=minute,h=hour,d=day.
1049 * --dr is now an alias for --dry-run.
1051 * Vote for GNU Parallel's community ads on
1052 http://meta.unix.stackexchange.com/a/4356/2972
1053 http://meta.askubuntu.com/a/16750/22307
1054 http://meta.serverfault.com/a/9040/45704
1056 * GNU Parallel was cited in: Feature Detection in Visual Cortex during
1057 Different Functional States
1058 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5397493/
1060 * GNU Parallel was cited in: From genotype to phenotype: inferring
1061 relationships between microbial traits and genomic components
1062 https://docserv.uni-duesseldorf.de/servlets/DerivateServlet/Derivate-44622/main.pdf
1064 * GNU Parallel was cited in: Designing fecal microbiota transplant
1065 trials that account for differences in donor stool efficacy
1066 http://biorxiv.org/content/biorxiv/early/2016/07/25/065383.full.pdf
1068 * GNU Parallel was cited in: Assessing the predictability of
1069 anharmonic vibrational modes at the example of hydroxyl groups - ad
1070 hoc construction of localised modes and the influence of structural
1071 solute–solvent motifs
1072 http://pubs.rsc.org/-/content/articlelanding/2017/cp/c7cp01662j#!divAbstract
1074 * GNU Parallel was cited in: Mapping Environmental Influences on
1076 ftp://frapftp.fire.ca.gov/outgoing/transfer/PUC_Map1/Utility%20Fire%20map%201%20final%20review%20and%20development%20report21616.pdf
1078 * GNU Parallel was cited in: Weak vs. Strong Disorder Superfluid-Bose
1079 Glass Transition in One Dimension
1080 https://arxiv.org/pdf/1704.02257.pdf
1082 * GNU Parallel was cited in: Online Automatic Post-editing for MT in a
1083 Multi-Domain Translation Environment
1084 https://www.aclweb.org/anthology/E/E17/E17-1050.pdf
1086 * GNU Parallel was cited in: Cross-calibration of S-NPP VIIRS
1087 moderate-resolution reflective solar bands against MODIS Aqua over
1089 http://www.atmos-meas-tech.net/10/1425/2017/amt-10-1425-2017.pdf
1091 * GNU Parallel was cited in: Scattering Networks: Efficient 2D
1092 Implementation And Application To Melanoma Classification
1093 http://amslaurea.unibo.it/12261/1/nurrito_eugenio_tesi_fisica_magistrale.pdf
1095 * GNU Parallel was cited in: Genome-scale detection of positive
1096 selection in 9 primates predicts human-virus evolutionary conflicts
1097 http://biorxiv.org/content/biorxiv/early/2017/04/27/131680.full.pdf
1099 * GNU Parallel is used in: Creates a speech dataset for deep learning
1100 https://github.com/jupiter126/Create_Speech_Dataset
1102 * GNU Parallel is used in: Parse and process the demixing secrets
1103 dataset (DSD100) https://github.com/faroit/dsdtools
1105 * First glance at the gnu parallel utility
1106 https://ibiscybernetics.com/blog/2017-04-05.html
1108 * Installing parallel from source
1109 https://bitsanddragons.wordpress.com/2017/05/03/installing-parallel-from-source/
1111 * How to run command or code in parallel in bash shell under Linux or
1113 https://www.cyberciti.biz/faq/how-to-run-command-or-code-in-parallel-in-bash-shell-under-linux-or-unix/
1115 * Parallel Serial Jobs Using GNU Parallel
1116 http://www.hpc.lsu.edu/training/weekly-materials/2017-Spring/gnuparallel-Feb2017.pdf
1118 * GNU Parallel or How to list millions of S3 objects
1119 https://joeray.me/gnu-parallel-how-to-list-millions-objects.html
1121 * Which Is the Best Tool for Copying a Large Directory Tree Locally?
1122 http://arjon.es/2017/05/11/which-is-the-best-tool-for-copying-a-large-directory-tree-locally/
1124 * Bug fixes and man page updates.
1129 * --halt supports done in addition to success and fail.
1131 * parset will set variables in parallel in Bash.
1133 * Perl 5.6 on Irix is no longer supported.
1135 * Vote for GNU Parallel's community ads on
1136 http://meta.unix.stackexchange.com/a/4356/2972
1137 http://meta.askubuntu.com/a/16750/22307
1138 http://meta.serverfault.com/a/9040/45704
1140 * GNU Parallel was cited in: Halvade-RNA: Parallel variant calling
1141 from transcriptomic data using MapReduce
1142 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0174575
1144 * GNU Parallel was cited in: StrAuto: automation and parallelization
1145 of STRUCTURE analysis
1146 http://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-017-1593-0
1148 * GNU Parallel was cited in: Trespassing the Boundaries: Labeling
1149 Temporal Bounds for Object Interactions in Egocentric Video
1150 https://128.84.21.199/pdf/1703.09026.pdf
1152 * GNU Parallel is used in: https://github.com/lucascbeyeler/zmbackup
1154 * Using GNU Parallel
1155 https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
1157 * Find and xargs and parallel
1158 http://helpful.knobs-dials.com/index.php/Find_and_xargs_and_parallel#Parallel
1160 * Quick Introduction to GNU Parallel
1161 https://github.com/mlangill/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel
1163 * Data science at the command line https://www.slideshare.net/sharatsc/data-science-at-the-command-line
1165 * Bedtools笔记 http://www.jianshu.com/p/67b0665490ac
1167 * Bug fixes and man page updates.
1172 * --rpl can now take arguments by adding '(regexp)' in the replacement
1175 * Vote for GNU Parallel's community ads on
1176 http://meta.unix.stackexchange.com/a/4356/2972
1177 http://meta.askubuntu.com/a/16750/22307
1178 http://meta.serverfault.com/a/9040/45704
1180 * GNU Parallel was cited in: shmlast: An improved implementation of
1181 Conditional Reciprocal Best Hits with LAST and Python
1182 https://joss.theoj.org/papers/3cde54de7dfbcada7c0fc04f569b36c7
1184 * GNU Parallel was cited in: Prediction of relativistic electron flux
1185 in the Earth’s outer radiation belt at geostationary orbit by
1187 https://link.springer.com/article/10.1134/S0016793217010108
1189 * GNU Parallel was cited in: Higher likelihood of multiple bit-flips
1190 due to neutron-induced strikes on logic gates
1191 https://arxiv.org/pdf/1612.08239.pdf
1193 * GNU Parallel was cited in: A Monte Carlo Resampling Approach for the
1194 Calculation of Hybrid Classical and Quantum Free Energies
1195 http://pubs.acs.org/doi/pdfplus/10.1021/acs.jctc.6b00506
1197 * GNU Parallel was cited in: Learning string distance with smoothing
1198 for OCR spelling correction
1199 https://link.springer.com/article/10.1007/s11042-016-4185-5
1201 * GNU Parallel was cited in: The Breakdown of String Perturbation
1202 Theory for Many External Particles
1203 https://arxiv.org/pdf/1611.08003.pdf
1205 * GNU Parallel was cited in: Operations Research Applications in
1207 https://dspace.library.colostate.edu/bitstream/handle/11124/170687/Johnson_mines_0052E_11207.pdf?sequence=1&isAllowed=y
1209 * GNU Parallel was cited in: Parallel Computing: GNU Parallel
1210 http://www.blopig.com/blog/2017/02/parallel-computing-gnu-parallel/
1212 * Stig Sandbeck Mathisen: Change All The Passwords (Again)
1213 http://garf.us/2017/02/stig-sandbeck-mathisen-change-all-the-passwords-again/
1215 * Trabalhando como Paralelismo no Bash usando o GNU Parallel
1216 http://www.beyeler.com.br/2017/03/trabalhando-como-paralelismo-no-bash-usando-o-gnu-parallel/
1218 * GNU parallel と SQL*Loader 組み合わせ実行例
1219 https://blogs.oracle.com/LetTheSunShineIn/entry/gnu_parallel_%E3%81%A8_sql_loader
1221 * Bug fixes and man page updates.
1226 * env_parallel now supports /bin/sh, ash, dash.
1228 * --tee will pipe all data to all jobs. Used with --pipe/--pipepart
1229 and :::. Small example: seq 3333 | parallel --pipe --tee --tag 'grep
1230 {} | wc -l' ::: {0..9}
1232 * If --results {replstr} ends in /: save in dir. Otherwise save as
1233 file. Example: parallel --results {} echo {} ::: a b c
1235 * Vote for GNU Parallel's community ads on
1236 http://meta.unix.stackexchange.com/a/4356/2972
1237 http://meta.askubuntu.com/a/16750/22307
1238 http://meta.serverfault.com/a/9040/45704
1240 * GNU Parallel was cited in: Low-delay forwarding with multiple
1241 candidates for VANETs using multi-criteria decision making
1242 http://ieeexplore.ieee.org/document/7835961/
1244 * GNU Parallel was cited in: An Integrated Simulator and Dataset that
1245 Combines Grasping and Vision for Deep Learning
1246 https://arxiv.org/pdf/1702.02103.pdf
1248 * GNU Parallel was cited in: A Bayesian model selection approach for
1249 identifying differentially expressed transcripts from RNA sequencing
1250 data http://onlinelibrary.wiley.com/doi/10.1111/rssc.12213/full
1252 * GNU Parallel was cited in: The impact of copy number variation on
1253 gout, and the apple genome
1254 https://ourarchive.otago.ac.nz/bitstream/handle/10523/7060/BoocockJames2016MSc.pdf?sequence=3
1256 * GNU Parallel was cited in: Reaction rates for reaction-diffusion
1257 kinetics on unstructured meshes
1258 http://aip.scitation.org/doi/10.1063/1.4975167
1260 * GNU Parallel was cited in: Modeling prediction error improves power
1261 of transcriptome-wide association studies
1262 http://biorxiv.org/content/biorxiv/early/2017/02/14/108316.full.pdf
1264 * GNU Parallel was cited in: Proper experimental design requires
1265 randomization/balancing of molecular ecology experiments
1266 http://biorxiv.org/content/biorxiv/early/2017/02/17/109280.full.pdf
1268 * GNU Parallel was cited in: Experiment-based thermal micromagnetic
1269 simulations of the magnetization reversal for ns-range clocked
1271 http://aip.scitation.org/doi/full/10.1063/1.4974021
1273 * GNU Parallel was cited in: The University of Edinburgh’s systems
1274 submission to the MT task at IWSLT
1275 http://workshop2016.iwslt.org/downloads/IWSLT_2016_paper_27.pdf
1277 * Fast-GBS uses GNU Parallel: https://bitbucket.org/jerlar73/fast-gbs
1279 * Job: DevOps Engineer/Senior Systems Administrator in New York, New
1281 http://rockefeller.jobs/new-york-ny/devops-engineersenior-systems-administrator/2DB3408EAC9E4617AD238550F31C7641/job/
1283 * Training in GNU Parallel:
1284 https://www.carc.unm.edu/education-outreach/workshops--training/
1286 * Training in GNU Parallel:
1287 http://www.hpc.lsu.edu/training/registration.php?topic=Parallel%20Serial%20Jobs%20Using%20GNU%20Parallel&date=February%2022,%202017&time=9:00%20AM%20-%2011:00%20AM&place=307%20Frey&deadline=2017-02-21%2016:30:00
1289 * Batch Convert Images from PNG to JPEG
1290 http://coreygoldberg.blogspot.dk/2017/02/batch-convert-images-from-png-to-jpeg.html
1292 * Accelerating Oxford Nanopore Basecalling
1293 http://fowlerlab.org/2017/01/26/accelerating-oxford-nanopore-basecalling/
1295 * parallel и imagemagick в loop на bash
1296 https://www.linux.org.ru/forum/development/13190247
1298 * Bug fixes and man page updates.
1308 * sql now uses a temporary credentials file for MySQL to avoid
1311 * --sqlmaster and --sqlworker have been reworked.
1313 * --sqlworker only reads from the DBURL: any command and any arguments
1316 * --sqlmaster +DBURL will append different commands to the DBURL and
1317 not erase the table.
1319 * If --results contain a replacement string, no tree structure with
1320 args will be generated.
1322 * --fg --tmux or --fg --tmuxpane will connect to the tmux.
1324 * GNU Parallel was cited in: Fast, Automated Indoor Light Detection,
1325 Classification, and Measurement
1326 https://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-212.pdf
1328 * GNU Parallel was cited in: Unbiased RNA Shotgun Metagenomics in
1329 Social and Solitary Wild Bees Detects Associations with Eukaryote
1330 Parasites and New Viruses
1331 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0168456
1333 * GNU Parallel was cited in: Almost Event-Rate Independent Monitoring
1334 of Metric Temporal Logic
1335 http://people.inf.ethz.ch/trayteld/papers/tacas17-aerial/aerial.pdf
1337 * 使用GNU parallel命令并行预处理数据: https://blog.razrlele.com/p/1843
1339 * GNU Parallel as a queuing system:
1340 http://puntoblogspot.blogspot.com/2017/01/gnu-parallel-as-queuing-system.html
1342 * AWS re:Invent 2016: Deep Dive on Amazon Elastic File System (STG202)
1344 http://www.slideshare.net/AmazonWebServices/aws-reinvent-2016-deep-dive-on-amazon-elastic-file-system-stg202
1345 and https://youtu.be/PlTuJx4VnGw?t=30m16s
1347 * Bug fixes and man page updates.
1352 * --results foo.csv will save output as a CSV-file. Can be directly
1353 imported into R or LibreCalc.
1355 * When using --pipepart a negative --block-size is not interpreted as
1356 a block size but as the number of blocks each jobslot should have.
1358 * --sqlmaster/--sqlandworker will append jobs to the DBURL if the
1359 DBURL is prepended with +.
1361 * GNU Parallel was cited in: A cloud-based workflow to quantify
1362 transcript-expression levels in public cancer compendia
1363 http://www.nature.com/articles/srep39259
1365 * GNU Parallel was cited in: Determination of crystal structures of
1366 proteins of unknown identity using a marathon molecular replacement
1367 procedure: Structure of Stenotrophomonas maltophilia
1368 phosphate-binding protein
1369 https://www.researchgate.net/publication/308186413_Determination_of_crystal_structures_of_proteins_of_unknown_identity_using_a_marathon_molecular_replacement_procedure_Structure_of_Stenotrophomonas_maltophilia_phosphate-binding_protein
1371 * GNU Parallel was cited in: Large-scale benchmarking reveals false
1372 discoveries and count transformation sensitivity in 16S rRNA gene
1373 amplicon data analysis methods used in microbiome studies
1374 http://microbiomejournal.biomedcentral.com/articles/10.1186/s40168-016-0208-8
1376 * GNU Parallel was cited in: Decomposing Images into Layers via
1378 https://cs.gmu.edu/~ygingold/singleimage/Decomposing%20Images%20into%20Layers%20via%20RGB-space%20Geometry%20(Tan%20et%20al%202016%20TOG)%20small.pdf
1380 * Transient compute clustering with GNU Parallel and sshfs
1381 https://gist.github.com/Brainiarc7/24c966c8a001061ee86cc4bc05826bf4
1383 * 4 Ways to Batch Convert Your PNG to JPG and Vice-Versa
1384 http://www.tecmint.com/linux-image-conversion-tools/
1386 * All's Fair in Love and Distributed Storage
1387 http://cohesity.com/blog/alls-fair-love-distributed-storage/
1389 * How can I use GNU Parallel to run a lot of commands in parallel
1390 https://www.msi.umn.edu/support/faq/how-can-i-use-gnu-parallel-run-lot-commands-parallel
1392 * 정해영의 블로그 - JEONG Haeyoung's blog
1393 http://blog.genoglobe.com/2016/11/gnu-parallel.html
1395 * 在Linux下将PNG和JPG批量互转的四种方法
1396 http://os.51cto.com/art/201612/524182.htm
1398 * Running in parallel http://tomkimpson.com/howto/gnuparallel/
1400 * Taco Bell Parallel Programming
1401 https://giorgos.sealabs.net/taco-bell-parallel-programming.html
1403 * Bug fixes and man page updates.
1408 * --record-env can now be used with env_parallel for bash, ksh, pdksh,
1411 * GNU Parallel was cited in: An improved implementation of Conditional
1412 Reciprocal Best Hits with LAST and Python
1413 https://pypi.python.org/pypi/shmlast/1.0.3
1415 * GNU Parallel was cited in: miRPathDB: a new dictionary on microRNAs
1417 http://nar.oxfordjournals.org/content/early/2016/10/13/nar.gkw926.full
1419 * GNU/Parallel – Run multiple commands simultaneously
1420 https://vinusumi.wordpress.com/2016/11/08/gnuparallel-run-multiple-commands-simultaneously/
1422 * Tutorial: Parallel web scraping with CasperJS and GNU Parallel
1423 http://g-liu.com/blog/2016/10/tutorial-parallel-web-scraping-with-casperjs-and-gnu-parallel/
1425 * Bug fixes and man page updates.
1430 * First command no longer gets stdin as it causes unpredictable issues.
1432 * GNU Parallel was cited in: Efficiently parallelized modeling of
1433 tightly focused, large bandwidth laser pulses
1434 https://arxiv.org/pdf/1609.08146v1.pdf
1436 * How to crunch lots of geodata in parallel
1437 http://blog.faraday.io/how-to-crunch-lots-of-geodata-in-parallel/
1439 * GNU parallel is my new toaster
1440 http://amedee.me/gnu-parallel-is-my-new-toaster/index.html
1442 * Bug fixes and man page updates.
1447 * parcat - cat files or fifos in parallel
1449 * GNU Parallel was cited in: Velocity: A Netflow Based Optimized
1451 https://mospace.umsystem.edu/xmlui/bitstream/handle/10355/50842/Thesis_2016_Pakhare.pdf?sequence=1&isAllowed=y
1453 * GNU Parallel was cited in: Viral deep sequencing needs an adaptive
1454 approach: IRMA, the iterative refinement meta-assembler
1455 http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5011931/
1457 * Using GNU Parallel and ImageMagick for Conversions
1458 https://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
1460 * Training in GNU Parallel
1461 http://www.cism.ucl.ac.be/Services/Formations/parcomp.pdf
1463 * Chown Ceph OSD data directory using GNU Parallel
1464 http://blog.widodh.nl/2016/08/chown-ceph-osd-data-directory-using-gnu-parallel/
1466 * FastGBS uses GNU Parallel https://bitbucket.org/jerlar73/fastgbs
1468 * dDocent: A guide to ddRAD sequencing
1469 https://ddocent.wordpress.com/ddocent-pipeline-user-guide/
1471 * SOFTWARE GNU Parallel
1472 http://msi-riss.readthedocs.io/en/latest/software/gnu-parallel.html
1474 * Bug fixes and man page updates.
1479 * --tmuxpane opens jobs in panes in tmux. Useful if you want to
1480 monitor progress of less than 100 simultaneous jobs.
1482 * --linebuffer now treats \r as line ending, too.
1484 * Perl changes forces use of floats to be given with leading zero, so
1487 * --xapply renamed to --link.
1489 * Support for pdksh will fade until someone packages it for Ubuntu 16.
1491 * GNU Parallel was cited in: Exome sequencing of geographically
1492 diverse barley landraces and wild relatives gives insights into
1493 environmental adaptation
1494 http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3612.html?WT.feed_name=subjects_genetics#references
1496 * GNU Parallel was cited in: Vision-Enhanced Lidar Odometry and
1497 Mapping https://www.ri.cmu.edu/pub_files/2016/8/DLL-thesis.pdf
1499 * Easy parallelization with GNU parallel
1500 http://mpharrigan.com/2016/08/02/parallel.html
1502 * Facebook V: Predicting Check Ins, Winner's Interview: 2nd Place,
1504 http://blog.kaggle.com/2016/08/02/facebook-v-predicting-check-ins-winners-interview-2nd-place-markus-kliegl/
1507 http://www.manitou-mail.org/blog/2016/07/parallel-import/
1509 * Large file batch processing using NodeJs and GNU Parallel
1510 http://www.zacorndorff.com/2016/07/27/large-file-batch-processing-using-nodejs-and-gnu-parallel/
1512 * Bug fixes and man page updates.
1517 * env_parallel is now ready for wider testing. It is still beta
1520 * env_parallel is heavily modified for all shells and testing has been
1523 * Selectively choosing what to export using --env now works for
1524 env_parallel (bash, csh, fish, ksh, pdksh, tcsh, zsh).
1526 * --round-robin now gives more work to a job that processes faster
1527 instead of same amount to all jobs.
1529 * --pipepart works on block devices on GNU/Linux.
1531 * GNU Parallel was cited in: HybPiper: Extracting Coding Sequence and
1532 Introns for Phylogenetics from High-Throughput Sequencing Reads
1533 Using Target Enrichment
1534 http://www.bioone.org/doi/full/10.3732/apps.1600016
1536 * GNU Parallel was cited in: StrAuto - Automation and Parallelization
1537 of STRUCTURE Analysis
1538 http://www.crypticlineage.net/download/strauto/strauto_doc.pdf
1540 * GNU Parallel was cited in: Tools and techniques for computational
1542 http://gigascience.biomedcentral.com/articles/10.1186/s13742-016-0135-4
1544 * GNU Parallel was cited in: FlashPCA: fast sparse canonical
1545 correlation analysis of genomic data
1546 http://biorxiv.org/content/biorxiv/suppl/2016/04/06/047217.DC1/047217-1.pdf
1548 * GNU Parallel was cited in: Math Indexer and Searcher under the Hood:
1549 Fine-tuning Query Expansion and Unification Strategies
1550 http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings12/pdf/ntcir/MathIR/05-NTCIR12-MathIR-RuzickaM.pdf
1552 * GNU Parallel was cited in: The Evolution and Fate of
1553 Super-Chandrasekhar Mass White Dwarf Merger Remnants
1554 http://arxiv.org/pdf/1606.02300.pdf
1556 * GNU Parallel was cited in: Evaluation of Coastal Scatterometer
1558 https://mdc.coaps.fsu.edu/scatterometry/meeting/docs/2016/Thu_AM/coastal-poster.pdf
1560 * GNU Parallel was used in: https://github.com/splitice/bulkdnsblcheck
1562 * The iconv slurp misfeature
1563 http://www.openfusion.net/linux/iconv_slurp_misfeature
1565 * แบบว่า CPU เหลือ https://veer66.wordpress.com/2016/06/15/gnu-parallel/
1567 * Bug fixes and man page updates.
1572 * $PATH can now be exported using --env PATH. Useful if GNU Parallel
1573 is not in your path on remote machines.
1575 * If --block is left out, --pipepart will use a block size that will
1576 result in 10 jobs per jobslot.
1578 * The cookie from 2016-01-04 was won by Morgan Rodgers on the
1579 2016-06-06 after 5 months.
1581 * Vote for GNU Parallel's community ad on
1582 https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
1584 * GNU Parallel was cited in: Genotypic Resistance Tests Sequences
1585 Reveal the Role of Marginalized Populations in HIV-1 Transmission in
1586 Switzerland http://www.nature.com/articles/srep27580
1588 * GNU Parallel was cited in: A Deep-Learning Approach for Operation of
1589 an Automated Realtime Flare Forecast
1590 https://arxiv.org/pdf/1606.01587.pdf
1592 * Unix parallel: Populating all the USB sticks
1593 http://www.markhneedham.com/blog/2016/06/01/unix-parallel-populating-all-the-usb-sticks/
1595 * GNU Parallel is a fantastic utility https://www.dray.be/parallel/
1597 * Combining a large number of VCF files
1598 https://gtamazian.com/2016/06/16/combining-a-large-number-of-vcf-files/
1600 * Useful Scraping Techniques
1601 http://blog.apps.npr.org/2016/06/17/scraping-tips.html
1603 * Tools of the trade
1604 http://onox.com.br/2015/05/tools-of-the-trade/#more-198
1606 * Armslist scraper https://github.com/nprapps/armslist-scraper/
1608 * Bug fixes and man page updates.
1613 * niceload --net pauses the program if the internet connection is
1616 * Vote for GNU Parallel's community ad on
1617 https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
1619 * Updated speed comparison between versions
1620 https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
1622 * GNU Parallel was cited in: Improving computation efficiency by
1623 parallel programming
1624 http://www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?C21COM=2&I21DBN=UJRN&P21DBN=UJRN&IMAGE_FILE_DOWNLOAD=1&Image_file_name=PDF/ape_2013_3_44.pdf
1626 * GNU Parallel was cited in: A supernova feedback implementation for
1627 the astrophysical simulation software Arepo
1628 https://arxiv.org/abs/1604.06071
1630 * GNU Parallel was cited in: Lorenz-Mie theory for 2D scattering and
1631 resonance calculations https://arxiv.org/pdf/1505.07691v2.pdf
1633 * GNU Parallel was cited in: Host-pathogen co-evolution and the
1634 emergence of broadly neutralizing antibodies in chronic infections
1635 https://arxiv.org/abs/1512.06296
1637 * GNU Parallel was cited in: Pacific People, Metabolic Disease and
1638 Evolutionary Processes: a mitochondrial DNA study
1639 https://otago.ourarchive.ac.nz/handle/10523/6340
1641 * GNU Parallel was cited in: The effect of domain modeling on
1642 efficiency of planning: Lessons from the Nomystery domain
1643 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7407131
1645 * GNU Parallel was cited in: Oops, my tests broke the build: An
1646 analysis of Travis CI builds with GitHub
1647 https://peerj.com/preprints/1984/
1649 * GNU Parallel was cited in: Drosophila Muller F Elements Maintain a
1650 Distinct Set of Genomic Properties Over 40 Million Years of
1651 Evolution http://www.g3journal.org/content/5/5/719.full.pdf+html
1653 * GNU Parallel was cited in: An Empirical Comparison of Neural
1654 Architectures for Reinforcement Learning in Partially Observable
1656 http://biorxiv.org/content/biorxiv/early/2016/03/24/022707.full.pdf
1658 * GNU Parallel was cited in: PleaseTM: Enabling Transaction Conflict
1659 Management in Requester-wins Hardware Transactional Memory
1660 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7446072
1662 * GNU Parallel was cited in: EASE-MM: Sequence-Based Prediction of
1663 Mutation-Induced Stability Changes with Feature-Based Multiple
1665 http://www.sciencedirect.com/science/article/pii/S0022283616000310
1667 * GNU Parallel was cited in: A new orthology assessment method for
1668 phylogenomic data: Unrooted Phylogenetic Orthology
1669 http://mbe.oxfordjournals.org/content/early/2016/04/06/molbev.msw069.short
1670 https://github.com/ballesterus/UPhO
1672 * GNU Parallel was cited in: Distinctive Interest Point Selection for
1673 Efficient Near-duplicate Image Retrieval
1674 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7459172
1676 * GNU Parallel was cited in: The Evolution of C Programming Practices:
1677 A Study of the Unix Operating System 1973–2015
1678 https://dl.acm.org/citation.cfm?id=2884799 (It has the cutest
1679 thumbnail graphs I have ever seen scattered all over the text)
1681 * GNU Parallel was cited in: Data processing pipeline for serial
1682 femtosecond crystallography at SACLA
1683 http://journals.iucr.org/j/issues/2016/03/00/zw5001/index.html
1685 * GNU Parallel was cited in: Reconstruction of Fine-Scale Auroral
1686 Dynamics http://arxiv.org/pdf/1512.01460.pdf
1688 * GNU Parallel was cited in: Genomic legacy of the African cheetah,
1690 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4676127/pdf/13059_2015_Article_837.pdf
1692 * GNU Parallel was cited in: Don’t Forget to Lock the Back Door! A
1693 Characterization of IPv6 Network Security Policy
1694 http://benign-research-probe2.eecs.umich.edu/ndss16_ipv6_final.pdf
1696 * GNU Parallel was cited in: Comprehensive Annotation of the
1697 Parastagonospora nodorum Reference Genome Using Next-Generation
1698 Genomics, Transcriptomics and Proteogenomics
1699 http://journals.plos.org/plosone/article/asset?id=10.1371%2Fjournal.pone.0147221.PDF
1701 * GNU Parallel was cited in: How attention influences perceptual
1702 decision making: Single-trial EEG correlates of drift-diffusion
1703 model parameters http://www.cidlab.com/prints/nunez2016attention.pdf
1705 * GNU Parallel was cited in: Telomere And Proximal Sequence Analysis
1706 Using High-Throughput Sequencing Reads
1707 http://repository.upenn.edu/edissertations/1460/
1709 * GNU Parallel was cited in: AT-GIS: Highly Parallel Spatial Query
1710 Processing with Associative Transducers
1711 http://lsds.doc.ic.ac.uk/sites/default/files/ATGIS-SIGMOD16.pdf
1713 * GNU Parallel was cited in: PVAIR: Partial Variable Assignment
1714 InterpolatoR http://verify.inf.usi.ch/sites/default/files/main-2.pdf
1716 * GNU Parallel was cited in: Comparative Cladistics: Fossils,
1717 Morphological Data Partitions and Lost Branches in the Fossil Tree
1718 of Life http://opus.bath.ac.uk/43955/
1720 * GNU Parallel was cited in: Shannon: An Information-Optimal de
1721 NovoRNA-Seq Assembler
1722 http://biorxiv.org/content/biorxiv/early/2016/02/09/039230.full.pdf
1724 * GNU Parallel was cited in: Adaptive Measure-Theoretic Parameter
1725 Estimation for Coastal Ocean Modeling
1726 https://repositories.lib.utexas.edu/handle/2152/32435
1728 * GNU Parallel was cited in: Computational Design of DNA-Binding
1730 http://link.springer.com/protocol/10.1007/978-1-4939-3569-7_16
1732 * GNU Parallel was cited in: Reference genotype and exome data from an
1733 Australian Aboriginal population for health-based research
1734 http://www.nature.com/articles/sdata201623
1736 * GNU Parallel was cited in: Do aye-ayes echolocate?
1737 http://biorxiv.org/content/biorxiv/early/2016/04/11/048165.full.pdf
1739 * GNU Parallel was cited in: Functional enrichments of disease
1740 variants across thousands of independent loci in eight diseases
1741 http://biorxiv.org/content/biorxiv/early/2016/04/11/048066.full.pdf
1743 * GNU Parallel was cited in: From genomes to phenotypes: Traitar, the
1744 microbial trait analyzer
1745 http://biorxiv.org/content/biorxiv/early/2016/03/12/043315.full.pdf
1747 * GNU Parallel was mentioned in: Fast Playback Framework for Analysis
1748 of Ground-Based Doppler Radar Observations Using MapReduce
1750 http://journals.ametsoc.org/doi/pdf/10.1175/JTECH-D-15-0118.1
1752 * NCBI blast tutorial
1753 https://github.com/enormandeau/ncbi_blast_tutorial
1755 * Distributed Preservation Made Simple
1756 https://blog.archive.org/2016/02/26/distributed-preservation-made-simple/
1758 * Parallel Jobs in Luigi http://rjbaxley.com/posts/2016/03/13/parallel_jobs_in_luigi.html
1760 * Bug fixes and man page updates.
1765 * :::+ and ::::+ work like ::: and :::: but links this input source to
1766 the previous input source in a --xapply fashion. Contrary to
1767 --xapply values do not wrap: The shortest input source determines
1770 * --line-buffer --keep-order now outputs continously from the oldest
1771 job still running. This is more what you would expect than the
1772 earlier behaviour where --keep-order had no effect with
1775 * env_parallel supports tcsh, csh, pdksh. In fish it now supports
1776 arrays. In csh/tcsh it now supports variables, aliases, and arrays
1777 with no special chars. In pdksh it supports aliases, functions,
1778 variables, and arrays.
1780 * Function exporting on Mac OS X works around old Bash version.
1782 * Better CPU detection on OpenIndiana.
1784 * GNU Parallel was cited in: Automatic Methods for Assisted
1786 https://www.researchgate.net/publication/297738658_Automatic_Methods_for_Assisted_Recruitment
1788 * GNU Parallel was cited in: Reinterpretation of ATLAS 8 TeV searches
1789 for Natural SUSY with a R-Sneutrino LSP
1790 http://arxiv.org/pdf/1603.06130.pdf
1792 * GNU Parallel was cited in: An Operational Radiometric Landsat
1793 Preprocessing Framework for Large-Area Time Series Applications
1794 https://www.uni-trier.de/fileadmin/fb6/prof/FER/Publikationen/frantz_et_al_ieee-tgrs-2016-post-print.pdf
1796 * A basic demo of how GNU Parallel can speed up execution of commands
1797 https://www.youtube.com/watch?v=kl8LO2jcvMc
1799 * qbatch uses GNU Parallel: https://pypi.python.org/pypi/qbatch/1.0rc2
1801 * FaceCrop uses GNU Parallel: https://github.com/EderSantana/FaceCrop
1803 * Parallel Processing with Catmandu
1804 https://librecatproject.wordpress.com/2016/04/20/parallel-processing-with-catmandu/
1807 http://staypython.blogspot.dk/2016/04/gnu-parallel.html
1809 * Bug fixes and man page updates.
1814 * env_parallel is a function that exports the environment (functions,
1815 aliases, variables, and arrays) to GNU Parallel. Run 'man
1816 env_parallel' for details.
1818 * niceload --prg now searches for substrings if no process with the
1821 * GNU Parallel was cited in: Random Forest DBSCAN for USPTO Inventor
1822 Name Disambiguation http://arxiv.org/pdf/1602.01792.pdf
1824 * GNU Parallel was mentioned (with wrong citation) in: Dual Level
1825 Parallel Computations for LargeScale High-Fidelity Database to
1826 Design Aerospace Vehicles
1827 http://www.nas.nasa.gov/assets/pdf/papers/Guruswamy_2013_DualLevelParallelComputations.pdf
1829 * Using ‘Parallel’ in Unix
1830 https://shearnrylan.wordpress.com/2016/02/22/using-parallel-in-unix/
1832 * JPEG Squish uses (and co-distributes) GNU Parallel:
1833 http://dantidswell.co.uk/jpeg-squish/
1835 * Bug fixes and man page updates.
1840 * Vote for new community on Superuser, Ask Ubuntu, Unix&Linux
1841 http://meta.superuser.com/questions/11127/community-promotion-ads-2016/11225#11225
1842 http://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
1843 http://meta.unix.stackexchange.com/questions/3854/community-promotion-ads-2016/3893#3893
1845 * Daily Quick Tip: parallel
1846 https://medium.com/@jacaetevha/daily-quick-tip-parallel-8772435f6582
1848 * Downloading a list of URLs
1849 http://blog.gypsydave5.com/2016/02/04/xargs-and-curl/
1851 * Using GNU Parallel and ImageMagick for Conversions
1852 http://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
1854 * Running bash commands in parallel
1855 http://linuxcommando.blogspot.dk/2016/01/running-bash-commands-in-parallel.html
1857 * parallel processing in PDAL
1858 https://smathermather.wordpress.com/2016/01/28/parallel-processing-in-pdal/
1860 * A Million Text Files And A Single Laptop
1861 http://randyzwitch.com/gnu-parallel-medium-data/
1863 * 「今日から使い切る」ための GNU Parallelによる並列処理入門
1864 http://www.slideshare.net/koji_matsuda/gnu-parallel
1866 * Bug fixes and man page updates.
1871 * --sql DBURL uses DBURL as storage for jobs and output. It does not
1872 run any jobs so it requires at least one --sqlworker. DBURL must
1875 * --sqlworker DBURL gets jobs from DBURL and stores the result back to
1878 * --sqlandworker is a shorthand for --sql and --sqlworker.
1880 * --sqlworker requires the output of a single job to fit in memory.
1882 * --results now also saves a file called 'seq' containing the sequence
1885 * If $PARALLEL_ENV is a file, then that file will be read into
1888 * man parallel_tutorial has been given an overhaul.
1890 * --workdir now accepts replacementstrings.
1892 * GNU Parallel was cited in: Possum - A Framework for
1893 Three-Dimensional Reconstruction of Brain Images from Serial
1894 Sections http://link.springer.com/article/10.1007/s12021-015-9286-1
1896 * GNU Parallel was cited in: A Genetic Algorithm for the selection of
1897 structural MRI features for classification of Mild Cognitive
1898 Impairment and Alzheimer's Disease
1899 http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=7359909&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7359909
1901 * GNU Parallel was cited in: The Effect of Domain Modeling on
1902 Performance of Planning Algorithms
1903 http://isaim2016.cs.virginia.edu/papers/ISAIM2016_Bartak_Vodrazka.pdf
1905 * Plotting time tables for jobs run by GNU Parallel
1906 https://github.com/ziotom78/plot_joblog
1908 * GNU Parallel was used in: Mission Impossible: you have 1 minute to
1909 analyze the Ebola Genome https://www.biostars.org/p/119397
1911 * GNU Parallel is used in LAST: http://last.cbrc.jp/
1913 * Distributed Log Search Using GNU Parallel
1914 http://codehate.com/blog/2015/12/01/distributed-log-search-using-gnu-parallel/
1916 * Bug fixes and man page updates.
1921 * --transfer is now an alias for --transferfile {}.
1923 * --transferfile works like --transfer, but takes an argument like
1924 --return. This makes it possible to combine transferring files
1925 with multiple input sources: parallel -S server --tf {1} wc {2}
1926 {1} ::: * ::: -l -w -c
1928 * total_jobs() can now be used in {= =}: parallel echo job {#} of '{=
1929 $_=total_jobs() =}' ::: {1..50}
1931 * GNU Parallel was cited in: Evolution and Learning in Heterogeneous
1933 http://research.gold.ac.uk/15078/1/COM_thesis_JonesD_2015.pdf
1935 * GNU Parallel was cited in: Achieving Consistent Doppler Measurements
1936 from SDO/HMI Vector Field Inversions
1937 http://arxiv.org/pdf/1511.06500.pdf
1939 * Flo uses GNU Parallel: https://github.com/wurmlab/flo
1941 * 使用 GNU parallel 來平行運算
1942 http://mutolisp.logdown.com/posts/316959-using-gnu-parallel-to-parallel-computing
1944 * Bug fixes and man page updates.
1949 * GNU Parallel packaged for CERN CentOS:
1950 http://linuxsoft.cern.ch/cern/centos/7/cern/x86_64/repoview/parallel.html
1952 * GNU Parallel was cited in: The Outer Solar System Origins Survey:
1953 I. Design and First-Quarter Discoveries
1954 http://arxiv.org/pdf/1511.02895.pdf
1956 * GNU Parallel was cited in: Contrasting genetic architectures of
1957 schizophrenia and other complex diseases using fast
1958 variance-components analysis
1959 http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3431.html
1961 * GNU Parallel was cited in: Named-Entity Chunking for Norwegian Text
1962 using Support Vector Machines
1963 http://ojs.bibsys.no/index.php/NIK/article/viewFile/248/211
1965 * GNU Parallel was cited in: Multiscale Estimation of Binding Kinetics
1966 Using Brownian Dynamics, Molecular Dynamics and Milestoning
1967 http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004381#pcbi.1004381.ref072
1969 * GNU Parallel was cited in: A Detailed Characterization of Errors in
1970 Logic Circuits due to Single-Event Transients
1971 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=7302348&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7302348
1973 * GNU Parallel was cited in: Arabic Speaker Emotion Classification
1974 Using Rhythm Metrics and Neural Networks
1975 http://www.eurasip.org/Proceedings/Eusipco/Eusipco2015/papers/1570104855.pdf
1977 * GNU Parallel was cited in: Stride Search: a general algorithm for
1978 storm detection in high resolution climate data
1979 http://www.geosci-model-dev-discuss.net/8/7727/2015/gmdd-8-7727-2015.pdf
1981 * GNU Parallel was cited in: Decomposing Digital Paintings into Layers
1982 via RGB-space Geometry http://arxiv.org/pdf/1509.03335.pdf
1984 * GNU Parallel was cited in: Structure and evolutionary history of a
1985 large family of NLR proteins in the zebrafish
1986 http://www.biorxiv.org/content/biorxiv/early/2015/09/18/027151.full.pdf
1988 * GNU Parallel was cited in: Evolution of movement strategies under
1989 competitive interactions
1990 http://digital.csic.es/bitstream/10261/115973/1/evolution_movement_strategies_Kiziridis.pdf
1992 * Automating large numbers of tasks
1993 https://rcc.uchicago.edu/docs/tutorials/kicp-tutorials/running-jobs.html
1995 * Max out your IOPs with GNU Parallel
1996 http://blog.bitratchet.com/2015/11/11/max-out-your-iops-with-gnu-parallel/
1998 * Bug fixes and man page updates.
2003 * --plus makes it possible to use {##} as a shorthand for
2004 {= $_=$Global::JobQueue->total_jobs() =} which gives the the number
2005 of jobs to run in total.
2007 * {= $_=$Global::JobQueue->total_jobs() =} is incompatible with -X,
2010 * GNU Parallel is now mostly compatible with lsh
2011 (http://www.lysator.liu.se/~nisse/lsh/) and somewhat compatible with
2012 autossh (http://www.harding.motd.ca/autossh/).
2014 * --workdir ... now also works when run locally.
2016 * GNU Parallel was cited in: There is no (75, 32, 10, 16) strongly
2017 regular graph http://arxiv.org/pdf/1509.05933.pdf
2019 * GNU Parallel was cited in: Roary: rapid large-scale prokaryote pan
2021 http://bioinformatics.oxfordjournals.org/content/early/2015/08/05/bioinformatics.btv421.full.pdf+html
2023 * GNU Parallel is used in TraitAR:
2024 https://testpypi.python.org/pypi/traitar/0.1.4
2026 * A parallel and fast way to download multiple files
2027 http://onetipperday.blogspot.com/2015/10/a-parallel-and-fast-way-to-download.html
2029 * Usar GNU Parallel para aumentar el rendimiento de tus scripts
2030 http://adrianarroyocalle.github.io/blog/2015/10/20/usar-gnu-parallel/
2032 * Bug fixes and man page updates.
2037 * GNU Parallel was cited in: Flexible Modeling of Epidemics with an
2038 Empirical Bayes Framework
2039 http://journals.plos.org/ploscompbiol/article?id=10.1371%2Fjournal.pcbi.1004382
2041 * GNU Parallel was cited in: BL1: 2D Potts Model with a Twist
2042 https://sucs.swan.ac.uk/~rjames93/Dissertation.pdf
2044 * GNU Parallel was cited in: A Scalable Parallel Implementation of
2045 Evolutionary Algorithms for Multi-Objective Optimization on GPUs
2046 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7257074
2048 * GNU Parallel was cited in: How Can We Measure the Similarity Between
2049 Résumés of Selected Candidates for a Job?
2050 https://www.researchgate.net/publication/275954089_How_can_we_measure_the_similarity_between_rsums_of_selected_candidates_for_a_job
2052 * GNU Parallel was cited in: Interplay of cell dynamics and epithelial
2053 tension during morphogenesis of the Drosophila pupal wing
2054 http://www.researchgate.net/profile/Raphael_Etournay/publication/279061859_Interplay_of_cell_dynamics_and_epithelial_tension_during_morphogenesis_of_the_Drosophila_pupal_wing/links/558a95ad08aeae8413bcceea.pdf
2056 * Third-party selling GNU Parallel T-shirts
2057 http://www.aliexpress.com/item/2015F-BSO-GNU-LOGO-GNU-PARALLEL-men-s-shirt-sleeve-visual-illusion-error/32464827966.html
2059 * Joys of gnu parallel
2060 http://scottolesen.com/index.php/2015/08/26/joys-of-gnu-parallel/
2062 * Crop and resize images with bash and ImageMagick
2063 https://www.simonholywell.com/post/2015/08/image-resize-crop-bash-imagemagick/
2065 * Three Ways to Script Processes in Parallel
2066 http://www.codeword.xyz/2015/09/02/three-ways-to-script-processes-in-parallel/
2068 * What It Looks Like to Process 3.5 Million Books
2069 http://blog.gdeltproject.org/what-it-looks-like-to-process-3-5-million-books/
2071 * Bug fixes and man page updates.
2076 * If $job->skip() is called in {= =} the job will not be run.
2078 * @arg can now be used in {= =}: parallel echo '{= $arg[2] < 5 and
2079 $_="j" =}' ::: 1 2 3 ::: 4 5 6
2081 * Version of GNU Parallel that uses PostgreSQL as backend
2082 https://github.com/stephen-fralich/parallel-sql/
2084 * SpeedSeq: ultra-fast personal genome analysis and interpretation
2085 http://www.nature.com/nmeth/journal/vaop/ncurrent/full/nmeth.3505.html
2087 * GNU Parallel is used in elPrep: https://github.com/ExaScience/elprep
2089 * Who actually reads the code?
2090 http://www.fsf.org/blogs/community/who-actually-reads-the-code
2092 * Introduction to GNU Parallel
2093 http://erictleung.com/2015/08/06/intro-to-gnu-parallel/
2095 * ¿Alguien se lee el código?
2096 http://www.taringa.net/post/linux/18854759/Alguien-se-lee-el-codigo.html
2098 * ¿Quién se lee el código fuente?
2099 https://victorhckinthefreeworld.wordpress.com/2015/08/12/quien-se-lee-el-codigo-fuente/
2101 * Distribution des traitements avec GNU Parallel
2102 http://blog.inovia-conseil.fr/?p=226#4
2104 * Эксперимент по проверке, читают ли код открытых проектов
2105 http://www.opennet.ru/opennews/art.shtml?num=42718
2107 * 多核心主機搭配 GNU parallel
2108 http://blog.zeroplex.tw/2015/08/gnu-parallel.html
2110 * Bug fixes and man page updates.
2115 * If a record fits in a block, --block only reads upto the size of
2116 --block. If not: --block reads a full --block more.
2118 * Due to widely spread distributions still using --tollef even after a
2119 year of being retired following a year of being obsolete, --tollef
2120 now gives an error unless used with --gnu.
2122 * --nice now uses a perl wrapper instead of the nice command.
2124 * Cookie 2013-08-18 was won by Mark Maimone, 1 year and 11 months
2127 * A parser for GNU Parallel --joblog files:
2128 https://github.com/harryjubb/joblog
2130 * GNU Parallel was cited in: Dynamical formation & scattering of
2131 hierarchical triples: Cross sections, Kozai-Lidov oscillations, and
2132 collisions http://arxiv.org/pdf/1507.03593.pdf
2134 * GNU Parallel was cited in: A Fast Compiler for NetKAT
2135 http://arxiv.org/pdf/1506.06378.pdf
2137 * GNU Parallel was cited in: Decomposing Time-Lapse Paintings into
2139 http://cs.gmu.edu/~ygingold/timemap/Decomposing%20Time-Lapse%20Paintings%20into%20Layers%20(Tan%20et%20al%202015%20SIGGRAPH)%20600dpi.pdf
2141 * GNU Parallel was used in: Somatic mutation calling from the matched
2142 tumor-normal exome-sequencing
2143 http://fafner.meb.ki.se/biostatwiki/somac/
2145 * Parallel Processing from the Command Line
2146 https://www.perpetual-beta.org/weblog/parallel-processing-from-the-command-line.html
2148 * Using GNU Parallel to speed up network operations
2149 http://vielmetti.typepad.com/vacuum/2015/06/using-gnu-parallel-to-speed-up-network-operations.html
2151 * Crawl faster with "parallel" - but how fast?
2152 http://andreas-wpv.blogspot.com/2015/07/crawl-faster-with-parallel-but-how-fast.html
2154 * Simultaneously benchmark many URLs with ApacheBench and GNU parallel
2155 https://www.simonholywell.com/post/2015/06/parallel-benchmark-many-urls-with-apachebench/
2157 * Bug fixes and man page updates.
2162 * --halt has been rewritten completely. You can now combine
2163 percentages with success or fail. See the man page.
2165 * Exit values 102..254 have been removed. 101 means more than 100 jobs
2168 * Killing through --timeout, --memfree, or --halt is now done as a
2171 * --termseq determines which signals are sent when a job is killed.
2173 * An empty argument would previously cause no string to be
2174 inserted. This is now changed to '' being inserted, thus prepending
2175 a space to the output of: parallel echo {} b ::: ''
2177 * $PARALLEL_ENV can now be set to an environment prepending the
2178 command. Used in env_parallel as mentioned in the manpage.
2180 * --retry-failed will retry all failed jobs in a joblog. It will
2181 ignore any command given.
2183 * --ssh and $PARALLEL_SSH can be used to set the command used for
2184 ssh. The command is assumed to behave the same way as ssh.
2186 * --fifo now works in csh, too.
2188 * Q(...) can be used in {= =} to shell quote a string.
2190 * GNU Parallel was cited in: DockBench: An Integrated Informatic
2191 Platform Bridging the Gap between the Robust Validation of Docking
2192 Protocols and Virtual Screening Simulations
2193 http://www.mdpi.com/1420-3049/20/6/9977
2195 * GNU Parallel was cited in: Swedes Online: You Are More Tracked Than
2197 http://www.diva-portal.org/smash/get/diva2:807623/FULLTEXT01.pdf
2199 * GNU Parallel was cited in: Tutorial: Lorenz-Mie theory for 2D
2200 scattering and resonance calculations
2201 http://arxiv.org/pdf/1505.07691.pdf
2203 * GNU Parallel was cited in: A quantitative assessment of the Hadoop
2204 framework for analyzing massively parallel DNA sequencing data
2205 http://link.springer.com/article/10.1186/s13742-015-0058-5
2207 * GNU Parallel was cited in: A composite genome approach to identify
2208 phylogenetically informative data from next-generation sequencing
2209 http://www.biomedcentral.com/content/pdf/s12859-015-0632-y.pdf
2211 * GNU Parallel is used in: taxator-tk
2212 http://algbio.cs.uni-duesseldorf.de/webapps/wa-download/
2214 * GNU Parallel is used in: https://github.com/d2207197/local-mapreduce
2216 * GNU Parallel is used in: wiki-edit-news https://github.com/albert-decatur/wiki-edit-news
2218 * GNU Parallel is used in: A Fingerprint Identification System
2219 https://curve.carleton.ca/system/files/theses/28733.pdf
2221 * Job ad asking for GNU Parallel experience:
2222 http://searchjobs.intel.com/gdansk-pol/software-validation-engineer/63A06826DAF24797AB414DC146201C2E/job/
2224 * Using BLAT http://wangzhengyuan.blogspot.dk/2015/06/using-blat.html
2226 * Bug fixes and man page updates.
2231 * Security: The security issue for --sshlogin + --fifo/--cat has been
2232 fixed. Thereby all issues with
2233 http://lists.gnu.org/archive/html/parallel/2015-04/msg00045.html
2236 * Security: After further security analysis the issue fixed in
2237 20150422 also fixed the problem for --tmux.
2239 * GNU Parallel was cited in: CIDER: a pipeline for detecting waves of
2240 coordinated transcriptional regulation in gene expression
2242 http://biorxiv.org/content/biorxiv/early/2015/03/17/012518.full.pdf
2244 * GNU Parallel was cited in: Building Genomic Analysis Pipelines in a
2245 Hackathon Setting with Bioinformatician Teams: DNA-seq, Epigenomics,
2246 Metagenomics and RNA-seq
2247 http://biorxiv.org/content/biorxiv/early/2015/05/05/018085.full.pdf
2249 * GNU Parallel was cited in: Sequencing the cap-snatching repertoire
2250 of H1N1 influenza provides insight into the mechanism of viral
2251 transcription initiation
2252 http://nar.oxfordjournals.org/content/early/2015/04/20/nar.gkv333.full.pdf
2254 * GNU Parallel was cited in: Genome assembly using Nanopore-guided
2255 long and error-free DNA reads
2256 http://www.biomedcentral.com/content/pdf/s12864-015-1519-z.pdf
2258 * GNU Parallel was used (unfortunately with wrong citation) in:
2259 Comparing the CarbonTracker and TM5-4DVar data assimilation systems
2260 for CO2 surface flux inversions
2261 http://www.atmos-chem-phys-discuss.net/15/8883/2015/acpd-15-8883-2015-discussion.html
2263 * GNU Parallel was used in: Gene Set Omic Analysis (GSOA) method
2264 https://bitbucket.org/srp33/gsoa
2266 * A Quick and Neat :) Orchestrator using GNU Parallel
2267 http://www.elsotanillo.net/2015/05/a-quick-and-neat-orchestrator-using-gnu-parallel/
2269 * Execute commands on multiple computers using GNU Parallel (setting
2270 up a cluster on the cheap)
2271 https://spectraldifferences.wordpress.com/2015/04/26/execute-commands-on-multiple-computers-using-gnu-parallel-setting-up-a-cluster-on-the-cheap/
2273 * Functions and GNU parallel for effective cluster load management
2274 http://genomespot.blogspot.dk/2015/04/functions-and-gnu-parallel-for.html
2276 * Use parallel processing to save time importing databases
2277 http://drupalsun.com/node/41854
2279 * Run multiple ssh commands in parallel with GNU Parallel
2280 http://www.ameir.net/blog/archives/380-run-multiple-ssh-commands-in-parallel-with-gnu-parallel.html
2282 * Importing huge databases faster
2283 https://www.lullabot.com/blog/article/importing-huge-databases-faster
2285 * Parallel? Gnu parallel! https://debian.pro/1834
2287 * Bug fixes and man page updates.
2292 New in this release:
2294 * Security fix. An attacker on the local system could make you
2295 overwrite one of your own files with a single byte. The problem
2296 exist when you use --compress or --tmux or --pipe or --cat or
2297 --fifo. The attacker must figure out the randomly chosen file name
2298 and create a symlink within a time window of 15 ms.
2300 * --shuf will generate all jobs, and shuffle them before running
2301 them. This is useful to get a quick preview of the results before
2302 running the full batch.
2304 * GNU Parallel now has a DOI: https://dx.doi.org/10.5281/zenodo.16303
2306 * GNU Parallel was cited in: Scaling Machine Learning for Target
2307 Prediction in Drug Discovery using Apache Spark
2308 https://cris.cumulus.vub.ac.be/portal/files/5147244/spark.pdf
2310 * GNU Parallel was cited in: Bayesian inference of protein structure
2311 from chemical shift data https://peerj.com/articles/861/
2313 * GNU Parallel was cited in: Toward Enhanced Metadata Quality of
2314 Large-Scale Digital Libraries: Estimating Volume Time Range
2315 https://www.ideals.illinois.edu/bitstream/handle/2142/73656/186_ready.pdf
2317 * GNU Parallel was cited in: Experimental study on the Wind Farm
2318 Substation Cable Installation Problem
2319 http://i11www.iti.uni-karlsruhe.de/_media/teaching/theses/ma-schmitz-14.pdf
2321 * GNU Parallel was used in: https://github.com/KAPPS-/landsat-gifworks
2323 * GNU Parallel was used in: https://github.com/exascience/elprep
2325 * GNU Parallel was used in:
2326 http://search.cpan.org/~jillrowe/HPC-Runner-GnuParallel-0.01/
2328 * GNU Parallel was used in:
2329 http://search.cpan.org/~ajpage/Bio-Roary-2.0.7/lib/Bio/Roary/JobRunner/Parallel.pm
2331 * GNU Parallel was used in: Rapid haploid SNP calling
2332 https://github.com/tseemann/snippy
2334 * Pictures and Metadata
2335 http://www.ozzy.no/2015/02/05/pictures-and-metadata/
2337 * Task automation with bash and parallel
2338 https://biowize.wordpress.com/2015/03/23/task-automation-with-bash-and-parallel/
2340 * How To: Speed Up File Transfers in Linux using RSync with GNU
2342 http://www.yourownlinux.com/2015/04/speed-up-file-transfers-using-rsync-with-gnu-parallel.html
2344 * Mirroring a Git Repository
2345 https://avacariu.me/articles/mirroring-a-git-repository.html
2347 * Add an ENVI header to JAXA Global Mangrove Watch PALSAR tiles
2348 https://spectraldifferences.wordpress.com/2015/03/24/add-an-envi-header-to-jaxa-global-mangrove-watch-palsar-tiles/
2351 http://www.zhihu.com/question/29257300
2353 * Bug fixes and man page updates.
2358 New in this release:
2360 * --number-of-cores respects 'taskset' on GNU/Linux.
2362 * --joblog --pipe gives the data send and received in the log.
2364 * GNU Parallel was tested to support 100 GB sized records in --pipe. A
2365 few bugs was fixed to support >2 GB records. It works, but is rather
2368 * GNU Parallel was cited in: RIG: Recalibration and Interrelation of
2369 genomic sequence data with the GATK
2370 http://www.g3journal.org/content/early/2015/02/13/g3.115.017012.full.pdf+html
2372 * GNU Parallel was cited in: MPI-blastn and NCBI-TaxCollector:
2373 Improving metagenomic analysis with high performance classification
2374 and wide taxonomic attachment
2375 http://www.worldscientific.com/doi/abs/10.1142/S0219720014500139?af=R&
2377 * GNU Parallel was cited in: Recent evolution in Rattus norvegicus is
2378 shaped by declining effective population size
2379 http://biorxiv.org/content/biorxiv/early/2015/03/01/015818.full.pdf
2381 * GNU Parallel was cited in: Evidence for DCO+ as a probe of
2382 ionization in the warm disk surface
2383 http://arxiv.org/pdf/1503.02659.pdf
2385 * GNU Parallel was cited in: De novo assembly and annotation of the
2386 Asian tiger mosquito (Aedes albopictus) repeatome with dnaPipeTE
2387 from raw genomic reads and comparative analysis with the yellow
2388 fever mosquito (Aedes aegypti)
2389 http://gbe.oxfordjournals.org/content/early/2015/03/11/gbe.evv050.full.pdf
2391 * GNU Parallel was cited in: A General Approach to Network
2392 Configuration Analysis
2393 http://research.microsoft.com/en-us/um/people/ratul/papers/nsdi2015-batfish.pdf
2395 * GNU Parallel was cited in: Scrimer: designing primers from
2397 http://onlinelibrary.wiley.com/doi/10.1111/1755-0998.12403/pdf
2399 * GNU Parallel was cited in: Efficient Retrieval of Key Material for
2400 Inspecting Potentially Malicious Traffic in the Cloud
2401 http://sacko.uk/pdf/2015.1.pdf
2403 * GNU Parallel will be presented at Strataconf: Poor Man's Parallel
2405 http://strataconf.com/big-data-conference-uk-2015/public/schedule/detail/40031
2407 * GNU Parallel was used in:
2408 https://github.com/alexbyrnes/FCC-Political-Ads_The-Code
2410 * GNU Parallel was used in: https://github.com/martymac/fpart
2412 * GNU Parallel was used in:
2413 https://github.com/hoytak/diabetic-retinopathy-code
2415 * GNU Parallel was used in:
2416 https://github.com/mehmattski/HybSeqPipeline
2418 * GNU Parallel was used in:
2419 http://search.cpan.org/~ajpage/Bio-Roary-2.0.0/lib/Bio/Roary/JobRunner/Parallel.pm
2421 * Using GNU Parallel on a Raspberry Pi cluster:
2422 http://www.dcglug.org.uk/cluster-progress/
2424 * An introduction to vector tiling and map reduce in postgis:
2425 http://dimensionaledge.com/intro-vector-tiling-map-reduce-postgis/
2427 * Running scripts in parallel with GNU Parallel:
2428 http://code.jasonbhill.com/2015/03/
2430 * Mahout: Parallelising the creation of DecisionTrees:
2431 http://www.markhneedham.com/blog/2012/12/27/mahout-parallelising-the-creation-of-decisiontrees/
2433 * High-Performance Scientific Computing: Running serial jobs in
2435 https://support.scinet.utoronto.ca/education/staticpublic/course178/serial.pdf
2437 * Parallel cardinality on your laptop
2438 https://highonscience.wordpress.com/2015/03/15/parallel-cardinality-on-your-laptop/
2440 * Experiments about a better locate using grep
2441 http://a3nm.net/blog/better_locate.html
2443 * Homework with GNU Parallel:
2444 https://support.scinet.utoronto.ca/education/staticpublic/course178content349.html
2446 * Parallel - Jobs in Skripten parallelisieren:
2447 https://slzm.de/blog/linux-tool-des-tages-parallel-jobs-in-skripten-parallelisieren/#more-612
2449 * GNU Parallel, czyli 100% użycia procesora
2450 http://matmatyk.blogspot.dk/2015/03/gnu-parallel-czyli-100-uzycia-procesora.html
2452 * Bug fixes and man page updates.
2457 * --tmux has gotten a major overhaul.
2459 * GNU Parallel was cited in: RaftLib: A C++ Template Library for High
2460 Performance Stream Parallel Processing
2461 http://www.cs.wustl.edu/~lip/pubs/pmam15_jbeard.pdf
2463 * GNU Parallel was cited in: Quantifying properties of hot and dense
2464 QCD matter through systematic model-to-data comparison
2465 http://arxiv.org/pdf/1502.00339.pdf
2467 * GNU Parallel was cited in: Towards Collaborative Exploration and
2468 Analysis of Big Data from Mars: A Noachis Terra Case Study
2469 http://link.springer.com/chapter/10.1007/978-3-319-13865-7_25
2471 * GNU Parallel was used (unfortunately with wrong citation) in:
2472 Performance and Scaling Comparison Study of RDBMS and NoSQL
2474 http://ijact.in/wp-content/uploads/2014/11/COMPUSOFT-311-1270-1275.pdf
2476 * GNU Parallel was used (unfortunately without citation) in: Parallel
2477 Implementation of Big Data Pre-Processing Algorithms for Sentiment
2478 Analysis of Social Networking Data
2479 http://www.researchmathsci.org/IJFMAart/ijfma-v6n2-7.pdf
2481 * GNU Parallel was used (unfortunately without citation) in: SpeedSeq:
2482 Ultra-fast personal genome analysis and interpretation
2483 http://biorxiv.org/content/biorxiv/early/2014/12/05/012179.full.pdf
2485 * Zip Folders with GNU Parallel
2486 http://fazky.github.io/posts/Linux/2015-01-07-GNU-Parallel.html
2488 * Using GNU Parallel with Freesurfer
2489 http://programminginadarkroom.blogspot.dk/2015/02/using-gnu-parallel-with-freesurfer.html
2491 * GNU Parallel is used in Velociraptor: https://github.com/ericwhyne/Velociraptor
2493 * Marcus Beach GNU Parallel http://marcusbeach.co/gnu-parallel/
2495 * Bug fixes and man page updates.
2500 * Remote jobs now send stderr (standard error) to stderr (standard
2501 error) instead of stdout (standard output).
2503 * Remote execution command is now packed using base64 encoded
2504 bzip2. This means that big environments (app. 100 KB) can be
2505 transferred. This change makes remote execution alpha quality.
2507 * --semaphoretimeout now takes a negative value. This means give up if
2508 the semaphore is not gotten within the timeout.
2510 * --halt -1 and -2 now means halt if a job succeeds (so the opposite
2513 * --no-keep-order will reverse --keep-order.
2515 * Bash's second fix of shellshock caused --env to break again when
2516 exporting functions. This has been fixed again.
2518 * A semibig refactoring of big functions. All non-trivial functions
2519 are now less than 100 lines. The refactoring makes this release beta
2522 * A description of the design decisions for GNU Parallel can be found
2523 in 'man parallel_design'.
2525 * A bug fix in replacement strings caused rewrite of the replacement
2526 function. This makes use of replacement strings alpha quality.
2528 * GNU Parallel was cited in: Improving Energy and Performance with
2529 Spintronics Caches in Multicore Systems
2530 http://link.springer.com/chapter/10.1007/978-3-319-14313-2_24
2532 * GNU Parallel was cited in: Parallel post-processing with MPI-Bash
2533 http://dl.acm.org/citation.cfm?id=2691137
2535 * GNU Parallel was cited in: Distinguishing cause from effect using
2536 observational data: methods and benchmarks
2537 http://arxiv-web3.library.cornell.edu/pdf/1412.3773.pdf
2539 * GNU Parallel was cited in: Data Science at the Command Line
2540 http://cdn.oreillystatic.com/oreilly/booksamplers/9781491947852_sampler.pdf
2542 * GNU Parallel was cited in: Resolution of Genetic Map Expansion
2543 Caused by Excess Heterozygosity in Plant Recombinant Inbred
2544 Populations http://www.g3journal.org/content/4/10/1963.full.pdf
2546 * GNU Parallel was cited in: Bayesian Inference of Protein Structure
2547 from Chemical Shift Data https://peerj.com/preprints/692v1.pdf
2549 * GNU Parallel was cited in: Clonal interference and Mullerʼs ratchet
2550 in spatial habitats http://iopscience.iop.org/1478-3975/11/5/056003
2552 * GNU Parallel was cited in: Computação Verde na Camada de Aplicação
2553 https://linux.ime.usp.br/~tpaiva/mac0499/files/monografia.pdf
2555 * GNU Parallel was cited in: Frameshift alignment: statistics and
2556 post-genomic applications
2557 http://bioinformatics.oxfordjournals.org/content/30/24/3575.full.pdf+html
2559 * GNU Parallel was cited in: Towards Recommender Engineering Tools and
2560 Experiments for Identifying Recommender Differences
2561 http://elehack.net/research/thesis/mde-thesis.pdf
2563 * GNU Parallel was cited in: Speaker Environment Classification Using
2564 Rhythm Metrics in Levantine Arabic Dialect
2565 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6923918
2567 * GNU Parallel was cited in: A Formal Proof Of The Kepler Conjecture
2568 http://arxiv.org/pdf/1501.02155.pdf
2570 * GNU Parallel was cited in: Allocation Policy Analysis for Cache
2571 Coherence Protocols for STT-MRAM-based caches
2572 http://conservancy.umn.edu/bitstream/handle/11299/169362/Nandkar_umn_0130M_15551.pdf
2574 * GNU Parallel was cited in: Using Trusted Platform Module for
2575 securing virtual environment access in Cloud
2576 http://dar.aucegypt.edu:8080/bitstream/handle/10526/4237/Using%20Trusted%20Platform%20Module%20for%20Securing%20Virtual%20Environment%20Access%20in%20Cloud.pdf
2578 * GNU Parallel was cited in: Weakly Supervised Learning for
2579 Compositional Sentiment Recognition
2580 http://computerlinguist.org/static/downloads/ma-thesis/Master_Thesis-Michael_Haas-Weakly_Supervised_Learning_for_Compositional_Sentiment_Recognition.pdf
2582 * GNU Parallel was cited in: Agility and Performance in Elastic
2583 Distributed Storage http://dl.acm.org/citation.cfm?id=2668129
2585 * GNU Parallel was used (unfortunately without citation) in: Large
2586 Scale Author Name Disambiguation in Digital Libraries
2587 http://semanticommunity.info/@api/deki/files/31523/P227_3546.pdf
2589 * GNU Parallel is used in BEDOPS:
2590 https://media.readthedocs.org/pdf/bedops/v2p5p0/bedops.pdf
2592 * Job ad asking for GNU Parallel skills:
2593 http://www.aplitrak.com/?adid=dXMzMTYxMjQuMzg0MTkuMTU1MEBtYW5wb3dlcmZveG5hLmFwbGl0cmFrLmNvbQ#sthash.kYCIhhty.KcoT6HnJ.dpbs
2595 * GNU Parallel: Open Source For You (OSFY) magazine, October 2013
2597 http://www.shakthimaan.com/posts/2014/11/27/gnu-parallel/news.html
2599 * Multithreaded Encryption and Compression
2600 http://www.krazyworks.com/multithreaded-encryption-and-compression/
2602 * GNU Parallel on OSX and Linux
2603 https://darknightelf.wordpress.com/2015/01/01/gnu-parallel-on-osx/
2605 * How to build gnu parallel from source on Ubuntu PC?
2606 http://blog.ovidiuparvu.com/build-gnu-parallel-source-ubuntu-pc/
2608 * GNU parallel for openaddr-process-one
2609 https://nelsonslog.wordpress.com/2015/01/09/gnu-parallel-for-openaddr-process-one/
2611 * From SRA Project to FastQ http://danielecook.com/sra-project-fastq/
2613 * Software Development Tooling
2614 http://www.computer.org/csdl/mags/so/2014/06/mso2014060021.pdf
2616 * コマンドを並列に実行するGNU parallelがとても便利
2617 http://bicycle1885.hatenablog.com/entry/2014/08/10/143612
2619 * Bug fixes and man page updates.
2624 * Remote systems can be divided into hostgroups (e.g. web and db) by
2625 prepending '@groupname/' to the sshlogin. Multiple groups can be
2626 given by separating groups with '+'. E.g. @web/www1 @web+db/www2
2629 * Remote execution can be restricted to servers that are part of one
2630 or more groups by '@groupname' as an sshlogin. Multiple groups can
2631 be given by separating groups with '+'. E.g. -S @web or -S @db+web
2633 * With --hostgroup you can restrict arguments to certain hostgroups by
2634 appending '@groupname' to the argument. Multiple groups can be
2635 given by separating groups with '+'. E.g. my_web_arg@web
2636 db-or-web-arg@db+web db-only-arg@db Thanks to Michel Courtine for
2637 developing a prototype for this.
2639 * GNU Parallel was cited in: HTSeq-Hadoop: Extending HTSeq for
2640 Massively Parallel Sequencing Data Analysis using Hadoop
2641 http://essenceofescience.se/wp-content/uploads/2014/11/Siretskiy.pdf
2643 * GNU Parallel was cited in: SlideToolkit: An Assistive Toolset for
2644 the Histological Quantification of Whole Slide Images
2645 http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0110289
2647 * GNU Parallel was cited in: Exploring a multiprocessor design space
2648 to analyze the impact of using STT-RAM in the memory hierarchy
2649 http://conservancy.umn.edu/bitstream/handle/11299/167286/Borse_umn_0130M_15431.pdf
2651 * Command-Line OCR with Tesseract on Mac OS X
2652 https://ryanfb.github.io/etc/2014/11/13/command_line_ocr_on_mac_os_x.html
2654 * Bug fixes and man page updates.
2659 * --env was changed to deal with Bash's new way of exporting a function.
2661 * GNU Parallel was cited in: Exclusion of cosmic rays in
2662 protoplanetary disks. II. Chemical gradients and observational
2663 signatures http://iopscience.iop.org/0004-637X/794/2/123/article
2665 * GNU Parallel was cited in: Application of Machine Learning to
2666 Algorithm Selection for TSP
2667 http://www.dbai.tuwien.ac.at/staff/musliu/art_ictai_cam.pdf
2669 * GNU Parallel was cited in: Performance Models for LTE-Advanced
2671 http://repository.asu.edu/attachments/137242/content/Tyagi_asu_0010E_14116.pdf
2673 * GNU Parallel was used (unfortunately without citation) in: De Novo
2674 Insertions and Deletions of Predominantly Paternal Origin Are
2675 Associated with Autism Spectrum Disorder
2676 http://www.cell.com/cms/attachment/2019079667/2039310868/mmc1.pdf
2678 * GNU Parallel was determined 'popular' by Statistical Analysis of
2679 Popular Open Source Software Projects and Their Communities
2680 http://andiwre.itmaranatha.org/prosiding/ICITEE2014/PaperAndiWRE-ICITEE2014.pdf
2682 * GNU Parallel is demonstrated in: Data Science at the Command Line:
2683 Facing the Future with Time-Tested Tools
2685 * GNU Parallel was covered in a talk at Sydney Perl Mongers group
2686 http://www.openfusion.net/talks/pwp/#24
2688 * GNU Parallel and how to get started with it
2689 http://www.jduck.net/blog/2014/09/30/gnu-paralell/
2691 * Behat/Selenium/Parallel
2692 http://jaffamonkey.com/behat-selenium-parallel/
2694 * Comparing Golang, Scala, Elixir and Ruby for ETL
2695 http://www.dimroc.com/2014/09/29/etl-language-showdown/
2697 * Assemble a list of which of these hosts are up or down
2698 http://opsfun.wordpress.com/2014/03/31/gnu-parallel/
2700 * Running commands on many nodes simultaneously
2701 http://opsfun.wordpress.com/2014/03/31/19/
2703 * Ubuntu 13.04でGNU ParallelをGNUモードで動かす
2704 http://qiita.com/YusukeSuzuki@github/items/7b96b5876bf980f21e85
2706 * Bug fixes and man page updates.
2711 * If the file give as --sshloginfile is changed it will be re-read
2712 when a job finishes though at most once per second. This makes it
2713 possible to add and remove hosts while running.
2715 * Brutha uses GNU Parallel https://pypi.python.org/pypi/brutha/1.0.2
2717 * OCRmyPDF uses GNU Parallel https://github.com/fritz-hh/OCRmyPDF/
2719 * GNU Parallel was presented at Balti and Bioinformatics "On-Air"
2720 http://youtu.be/UtXlr19xTh8?t=2h5m0s
2722 * Pleiades Plus uses GNU Parallel
2723 https://github.com/ryanfb/pleiades-plus
2725 * Imagemagick and GNU Parallel
2726 http://deepdish.io/2014/09/15/gnu-parallel/
2728 * GNU Parallel (Sebuah Uji Coba)
2729 http://pr4ka5a.wordpress.com/2014/09/04/gnu-parallel-sebuah-uji-coba/
2731 * GNU Parallel: 并行执行Linux命令
2732 http://blog.csdn.net/xzz_hust/article/details/39183837
2737 * GNU Parallel now uses the same shell it was started from as the
2738 command shell for local jobs. So if GNU Parallel is started from
2739 tcsh it will use tcsh as its shell even if the login $SHELL is
2740 different. For remote jobs the login $SHELL will be used.
2742 * The whole current environment in bash can be copied by using a shell
2743 wrapper function (Search manual for env_parallel).
2745 * --plus adds the replacement strings {+/} {+.} {+..} {+...} {..}
2746 {...} {/..} {/...}. The idea being that '+foo' matches the opposite
2747 of 'foo' and {} = {+/}/{/} = {.}.{+.} = {+/}/{/.}.{+.} = {..}.{+..}
2748 = {+/}/{/..}.{+..} = {...}.{+...} = {+/}/{/...}.{+...}
2750 * GNU Parallel now deals correctly with the combination
2751 rsync-3.1.X-client and rsync-2.5.7-server
2753 * GNU Parallel was cited in: A Web Service for Scholarly Big Data
2754 Information Extraction
2755 http://patshih.ist.psu.edu/publications/Williams-CiteSeerExtractor-ICWS14.pdf
2757 * Comparison of the speed of different GNU Parallel versions:
2758 http://lists.gnu.org/archive/html/parallel/2014-08/msg00030.html
2760 * GNU Parallel was covered in the webcast 2014-08-20: Data Science at
2761 the Command Line http://www.oreilly.com/pub/e/3115
2763 * Distributed processing with GNU parallel
2764 http://kazjote.eu/2014/08/11/distributed-processing-with-gnu-parallel
2766 * A Peek into GNU Parallel
2767 http://blog.dataweave.in/post/94238943763/a-peek-into-gnu-parallel
2769 * Сборка GNU parallel для CentOS/RHEL
2770 http://www.stableit.ru/2014/07/gnu-parallel-centosrhel.html
2772 * Bug fixes and man page updates.
2777 * {= perl expression =} can be used as replacement string. The
2778 expression should modify $_. E.g. {= s/\.gz$// =} to remove .gz from
2779 the string. This makes replacement strings extremely flexible.
2781 * Positional perl expressions (similar to {2}) are given as {=2 perl
2782 expression=} where 2 is the position.
2784 * One small backwards incompatibility: {1}_{2} will replace {2} with
2785 the empty string if there is only one argument. Previously {2} would
2786 have been left untouched.
2788 * Replacement strings can be defined using --rpl. E.g. parallel --rpl
2789 '{.gz} s/\.gz$//' echo {.gz} ::: *.gz
2791 * The parenthesis around {= perl expression =} can be changed with
2794 * --tmux will direct the output to a tmux session instead of
2795 files. Each running jobs will be in its own window.
2797 * --halt 10% will stop spawning new jobs if 10% failed so far.
2799 * GNU Parallel was cited in: bammds: A tool for assessing the ancestry
2800 of low depth whole genome data using multidimensional scaling (MDS)
2801 http://bioinformatics.oxfordjournals.org/content/early/2014/06/28/bioinformatics.btu410.abstract
2803 * GNU Parallel was cited in: Molecular ferroelectric contributions to
2804 anomalous hysteresis in hybrid perovskite solar cells
2805 http://people.bath.ac.uk/aw558/publications/2014/arxiv_hysteresis_14.pdf
2807 * GNU Parallel was cited in: Energy Sorghum-a genetic model for the
2808 design of C4 grass bioenergy crops
2809 http://jxb.oxfordjournals.org/content/early/2014/06/20/jxb.eru229.short
2811 * GNU Parallel was cited in: Web-scale Content Reuse Detection
2812 www.isi.edu/~johnh/PAPERS/Ardi14a.pdf
2814 * Tell your friends to sign up for the Webcast at 2014-08-20 covering
2815 GNU Parallel: Data Science at the Command Line
2816 http://www.oreilly.com/pub/e/3115
2818 * GNU Parallel all the things!
2819 http://longwayaround.org.uk/notes/gnu-parallel-all-the-things/
2821 * Shell command composition and dispatch
2822 http://lukeluo.blogspot.dk/2014/07/linux-virtual-console6-shell-command.html
2824 * Parallelising plink (or anything else) the easy way
2825 http://chrisladroue.com/2012/03/parallelising-plink-or-anything-else-the-easy-way/
2827 * Easy and cheap cluster building on AWS
2828 https://grapeot.me/easy-and-cheap-cluster-building-on-aws.html
2830 * Paralelizace běžných činností v konzoli pomocí GNU Parallel
2831 http://www.abclinuxu.cz/clanky/paralelizace-beznych-cinnosti-v-konzoli-pomoci-gnu-parallel
2833 * [原] Ubuntu 下使用 parallel 命令的注意事项
2834 http://blog.ailms.me/2014/06/28/ubuntu-with-parallel.html
2836 * 简单的并行, 可使用GNU parallel
2837 http://jerkwin.github.io/2014/06/10/GNU-parallel/
2839 * Bug fixes and man page updates.
2844 * --shebang and --shebang-wrap now works on FreeBSD.
2846 * --pipepart works with --header, --regexp, --cat and --fifo.
2848 * ./configure --disable-documentation will not build documentation.
2850 * {%} works as job slot.
2852 * GNU Parallel was cited in: Energy Efficient, High-speed
2853 Communication in WSNs
2854 https://gupea.ub.gu.se/bitstream/2077/35801/1/gupea_2077_35801_1.pdf
2856 * GNU Parallel was cited in: Ferroelectric contributions to anomalous
2857 hysteresis in hybrid perovskite solar cells
2858 http://arxiv.org/pdf/1405.5810.pdf
2860 * Processes Paralleling to Speed up Computing and Tasks Execution in
2862 http://kukuruku.co/hub/nix/processes-paralleling-to-speed-up-computing-and-tasks-execution-in-linux
2864 * Moving / Copying lots of s3 files quickly using gnu parallel
2865 http://blog.aclarke.eu/moving-copying-lots-of-s3-files-quickly-using-gnu-parallel/
2867 * Speeding up grep log queries with GNU Parallel
2868 http://www.tripwire.com/state-of-security/incident-detection/speeding-grep-queries-gnu-parallel/
2870 * Ubuntu - Gnu parallel - It's awesome
2871 http://kasunweranga.blogspot.dk/2014/06/ubuntu-gnu-parallel-its-awesome.html
2873 * Export quicklooks with vector overlay using TuiView
2874 http://spectraldifferences.wordpress.com/2014/03/08/export-quicklooks-with-vector-overlay-using-tuiview/
2876 * GNU Parallel指南 http://my.oschina.net/enyo/blog/271612
2878 * GNU parallelで違和感 http://jarp.does.notwork.org/diary/201405c.html#201405301
2880 * Bug fixes and man page updates.
2885 * Use --semaphoretimeout to ignore the semaphore lock after a while.
2887 * {%} introduced as job slot replacement string. It has known bugs.
2889 * --slotreplace changes slot replacement string.
2891 * GNU Parallel officially in Solaris 11.2beta
2892 https://blogs.oracle.com/alanc/entry/solaris_11_2_changes_to
2894 * GNU Parallel was cited in: A Comparison of Antenna Placement
2895 Algorithms http://abhinavjauhri.com/publications/eap.pdf
2897 * Using GNU Parallel on a PBS cluster (nice use of --shebang-wrap)
2898 https://docs.it4i.cz/anselm-cluster-documentation/resource-allocation-and-job-execution/capacity-computing
2900 * BioLite uses GNU Parallel: https://bitbucket.org/caseywdunn/biolite
2902 * Isitdown uses GNU Parallel: http://www.isi.edu/~calvin/isitdown.md
2904 * Convert FLAC to MP3 with GNU parallel
2905 http://www.blogobramje.nl/posts/Convert_FLAC_to_MP3_with_GNU_parallel/
2907 * JD Edwards Business Function Documentation
2908 http://www.azertech.net/content/jd-edwards-business-function-documentation
2910 * Tools of the trade http://blog.eikeland.se/2014/05/01/tools-of-the-trade/
2912 * How I start a bioinformatics project
2913 http://nickloman.github.io/2014/05/14/how-i-start-a-bioinformatics-project/
2915 * No:The-Me GNU Parallel http://adityalaghate.in/gnu-parallel.html
2917 * Bug fixes and man page updates.
2922 * --pipepart is a highly efficient alternative to --pipe if the input
2923 is a real file and not a pipe.
2925 * If using --cat or --fifo with --pipe the {} in the command will be
2926 replaced with the name of a physical file and a fifo respectively
2927 containing the block from --pipe. Useful for commands that cannot
2928 read from standard input (stdin).
2930 * --controlmaster has gotten an overhaul and is no longer
2933 * --env is now copied when determining CPUs on remote system. Useful
2934 for copying $PATH if parallel is not in the normal path.
2936 * --results now chops the argument if the argument is longer than the
2937 allowed path length.
2939 * Build now survives if pod2* are not installed.
2941 * The git repository now contains tags of releases.
2943 * GNU Parallel was cited in: Proactive System for Digital Forensic
2945 http://dspace.library.uvic.ca:8080/bitstream/handle/1828/5237/Alharbi_Soltan_PhD_2014.pdf
2947 * GNU Parallel was cited in: Beyond MAP estimation with the
2948 track-oriented multiple hypothesis tracker
2949 http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=6766651&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D6766651
2951 * GNU Parallel was cited in: Prokka: rapid prokaryotic genome
2953 http://bioinformatics.oxfordjournals.org/content/early/2014/03/18/bioinformatics.btu153.short
2955 * GNU Parallel was used (unfortunately with improper citation) in:
2956 Perspectives in magnetic resonance: NMR in the post-FFT era
2957 http://www.sciencedirect.com/science/article/pii/S1090780713003054
2959 * GNU Parallel is used in https://github.com/cc2qe/speedseq
2961 * Batch XML validation at the command line.
2962 http://horothesia.blogspot.dk/2014/04/batch-xml-validation-at-command-line.html
2964 * freebayes-parallel uses GNU Parallel
2965 https://github.com/ekg/freebayes/commit/31ee997984cebe8a196381c3de57e618e34a2281
2967 * Org-mode with Parallel Babel http://draketo.de/english/emacs/parallel-babel#sec-2
2969 * Speeding Up Grep Log Queries with GNU Parallel
2970 http://www.cybersecurity.io/speeding-grep-queries-gnu-parallel/
2972 * How to run tbss_2_reg in parallel
2973 http://tadpolebrainimaging.blogspot.dk/2014/03/how-to-run-tbss2reg-in-parallel.html
2975 * GNU parallel example: blastn https://asciinema.org/a/8775
2977 * Iterative DNS Brute Forcing
2978 http://www.room362.com/blog/2014/02/19/iterative-dns-brute-forcing/
2980 * Ejecutando comandos en paralelo
2981 http://jesusmercado.com/guias/ejecutando-comandos-en-paralelo/
2983 * Ejecutando en paralelo en bash (ejemplo con rsync)
2984 http://eithel-inside.blogspot.dk/2014/04/ejecutando-en-paralelo-en-bash-ejemplo.html
2986 * Bug fixes and man page updates.
2991 * Offical package for Alpine Linux now exists:
2992 http://alpinelinux.org/apk/main/x86/parallel
2994 * GNU Parallel was cited in: Estimating uncertainties in statistics
2995 computed from direct numerical simulation
2996 http://dx.doi.org/10.1063/1.4866813
2998 * GNU Parallel was cited in: Vehicle routing problems with time
2999 windows and multiple service workers: a systematic comparison
3000 between ACO and GRASP
3001 http://link.springer.com/article/10.1007/s10100-014-0341-z
3003 * GNU Parallel, quick and easy
3004 http://www.reganmian.net/blog/2014/03/09/gnu-parallel-quick-and-easy/
3006 * Using Multiple CPU Cores With Command Line Tools
3007 http://prateekvjoshi.com/2014/03/07/using-multiple-cpu-cores-with-command-line-tools/
3009 * Batch convert mp3 CBR to VBR
3010 http://blogs.zercle.com/bouroo/2013/03/batch-convert-mp3-cbr-to-vbr/
3012 * Running Behat in parallel with Selenium grid
3013 http://zalas.eu/running-behat-in-parallel-with-selenium-grid/
3015 * Git-Mirror per cronjob aktuell halten
3016 https://www.schtobia.de/2013/git-mirror-per-cronjob-aktuell-halten/
3018 * Пишем многопоточный скрипт на bash
3019 http://dafter.ru/duf/howto/130.html
3021 * 如何利用多核CPU来加速你的Linux命令
3022 http://www.chinadmd.com/file/xpcr6wpctzwtuu3ivwiaatcs_1.html
3024 * Bug fixes and man page updates.
3029 * --tollef has been retired.
3031 * --compress has be redesigned due to bugs.
3033 * Format of --eta and --joblog has changed slightly.
3035 * GNU Parallel was cited in: Speaker Verification and Keyword Spotting
3036 Systems for Forensic Applications
3037 http://lantana.tenet.res.in/website_files/thesis/Phd/srikanth.pdf
3039 * GNU Parallel was cited in: Scaleable Code Clone Detection
3040 http://scg.unibe.ch/archive/phd/schwarz-phd.pdf
3042 * GNU Parallel was cited in: Clone Detection that scales
3043 http://scg.unibe.ch/archive/masters/Vogt14a.pdf
3045 * GNU Parallel was cited in: Scalable Positional Analysis for Studying
3046 Evolution of Nodes in Networks
3047 http://arxiv-web3.library.cornell.edu/pdf/1402.3797
3049 * GNU Parallel was cited in: Aggregate Characterization of User
3050 Behavior in Twitter and Analysis of the Retweet Graph
3051 http://arxiv.org/pdf/1402.2671v1
3053 * GNU Parallel was used (unfortunately without citation) in: Causal
3054 Network Models for Predicting Compound Targets and Driving Pathways
3056 http://jbx.sagepub.com/content/early/2014/02/10/1087057114522690.full
3058 * GNU Parallel was used (unfortunately without citation) in:
3059 Performance and Energy Efficiency of Common Compression /
3060 Decompression Utilities
3061 http://www.researchgate.net/publication/243962643_Performance_and_Energy_Efficiency_of_Common_CompressionDecompression_Utilities_An_Experimental_Study_in_Mobile_and_Workstation_Computer_Platforms/file/3deec51d1dbc0474f9.pdf
3063 * GNU Parallel was used (unfortunately without citation) in: SpringFS:
3064 Bridging Agility and Performance in Elastic Distributed Storage
3065 http://www.istc-cc.cmu.edu/publications/papers/2014/SpringFS-FAST14.pdf
3067 * GNU Parallel was recommended (without citation) in: Redesigning the
3068 Specificity of Protein-DNA Interactions with Rosetta
3069 http://link.springer.com/protocol/10.1007/978-1-62703-968-0_17
3071 * GNU Parallel is co-distributed with RepeatExplorer
3072 http://www.vcru.wisc.edu/simonlab/bioinformatics/programs/repeatexplorer/README.txt
3074 * Convert MP3 to a scrolling spectrum waterfall plot video
3075 http://jdesbonnet.blogspot.dk/2014/02/convert-mp3-to-scrolling-spectrum.html
3077 * PHP wrapper class for the GNU Parallel tool
3078 https://github.com/geopal-solutions/gnu-parallel-wrapper/tree/master
3080 * Exploratory Data Analysis http://www.slideshare.net/thinrhino/gnunify
3082 * Copias de archivos con rsync y parallel
3083 http://linuxmanr4.com/2014/02/20/copias-de-archivos-con-rsync-y-parallel
3085 * Single-Thread-Programme auf Multicore-Rechnern parallelisieren
3086 http://www.adlerweb.info/blog/2014/02/08/linux-single-thread-programme-auf-multicore-rechnern-parallelisieren
3088 * Распараллеливаем процессы для ускорения вычислений и выполнения
3089 заданий в Linux http://savepearlharbor.com/?p=210480
3091 * Bug fixes and man page updates.
3096 * GNU Parallel was cited in: On the likelihood of multiple bit upsets
3098 http://arxiv-web3.library.cornell.edu/pdf/1401.1003
3100 * HaploClique uses GNU Parallel
3101 https://github.com/armintoepfer/haploclique
3103 * Scraping NSScreencast
3104 https://blog.nicolai86.eu/posts/2014-01-12/scraping-nsscreencast/
3106 * 30 Cool Open Source Software I Discovered in 2013
3107 http://www.cyberciti.biz/open-source/30-cool-best-open-source-softwares-of-2013/
3109 * [Unix] 13. The power of doing things in Parallel
3110 http://leetaey.tistory.com/384
3112 * Parallel the execution of a job that read from stdin
3113 http://www.linuxask.com/questions/parallel-the-execution-of-a-job-that-read-from-stdin
3115 * Mon Make à moi (6:38-11:50)
3116 http://videos.rennes.inria.fr/ReNaBI-GO2013/indexPierreLindenbaum.html
3118 * Shell-Abarbeitung beschleunigen: Wie Sie mit parallelen Prozesse
3119 effizienter in der Shell arbeiten
3120 https://www.hosteurope.ch/blog/shell-abarbeitung-beschleunigen-wie-sie-mit-parallelen-prozesse-effizienter-in-der-shell-arbeiten/
3122 * Summary of GNU Parallel tutorial
3123 http://hacktracking.blogspot.dk/2014/01/gnu-parallel-tutorial.html
3125 * Bug fixes and man page updates.
3130 * GNU Parallel now has a motto: For people who live life in the
3133 * Detect if the buffer dir $TMPDIR runs out of space. This changes a
3134 central piece of code, making this release alpha quality.
3136 * --keep-order --(n)onall will sort according to the sshlogin.
3138 * Detect the number of CPUs on DEC Tru64.
3140 * GNU sql: --list-tables for sqlite3.
3142 * GNU Parallel was cited in: Variational Message-Passing: Extension to
3143 Continuous Variables and Applications in Multi-Target Tracking
3144 http://www.ics.uci.edu/~ajfrank/pubs/thesis.pdf
3146 * GNU Parallel was cited in: Genome Assembly: Scaffolding Guided by
3148 https://www.duo.uio.no/handle/10852/37431
3150 * GNU Parallel was cited in: Metagenomic analysis of Mariana Trench
3152 http://repositorio.ul.pt/handle/10451/9436
3154 * GNU Parallel was cited in: Diacritization, automatic segmentation
3155 and labeling for Levantine Arabic speech
3156 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642556
3158 * GNU Parallel was cited in: Investigation of emotion classification
3159 using speech rhythm metrics
3160 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642591
3162 * GNU Parallel was cited in: A Rhythm-Based Analysis of Arabic Native
3163 and Non-Native Speaking Styles
3164 http://www.ijsps.com/uploadfile/2013/1128/20131128014413279.pdf
3166 * GNU Parallel was cited in: Evolutionary optimization of wetlands
3168 http://dl.acm.org/citation.cfm?id=2480400
3170 * GNU Parallel was cited (unfortunately with wrong citation) in:
3171 RDBMS vs NoSQL: Performance and Scaling Comparison
3172 http://www.epcc.ed.ac.uk/sites/default/files/Dissertations/2012-2013/RDBMS%20vs%20NoSQL%20-%20Performance%20and%20Scaling%20Comparison.pdf
3174 * GNU Parallel was used (without proper citation) in: Comprehensive
3175 Analysis Pipeline for Discovery of Human Genetic Variation
3176 http://www.google.com/patents/US20130311106
3178 * Encrypt and decrypt in parallel with GPG
3179 http://blog.tkassembled.com/412/encrypt-and-decrypt-in-parallel-with-gpg/
3181 * Using GNU Parallel to create a SVM classifier
3182 http://ivanyu.me/blog/2013/12/01/parallel/
3184 * Parallel xz compression
3185 http://anthon.home.xs4all.nl/rants/2013/parallel_xz/
3187 * Got CPUs to burn? Put 'em to work with GNU parallel
3188 http://baoilleach.blogspot.dk/2013/11/got-cpus-to-burn-put-em-to-work-with.html
3191 http://pastebin.com/JmnB9ffq
3193 * Gnu Parallel for fun and profit
3194 https://gist.github.com/celoyd/f7eb55ad69c9b33fd8c3
3196 * Parallelization of Exploitation
3197 http://rantsideasstuff.com/parallelization-of-exploitation/
3199 * Running assemblies in parallel
3200 https://khmer-protocols.readthedocs.org/en/v0.8.3/metagenomics/4-assemble.html
3202 * Procesando la contabilidad del PP
3203 http://www.neorazorx.com/2013/07/procesando-la-contabilidad-del-pp.html
3205 * Mon make à moi (French)
3206 http://www.slideshare.net/lindenb/mon-make-moi-tout-sauf-galaxy
3208 * Bug fixes and man page updates.
3213 * A citation notice is printed on stderr only if stderr is a terminal,
3214 the user has not specified --no-notice and the user has not run
3215 --bibtex once. This makes the release alpha quality.
3217 * --compress will compress temporary files. If the output is big and
3218 very compressible this will take up less disk space in $TMPDIR and
3219 possibly be faster due to less disk I/O.
3221 * --compress-program comtrols which program to use for compressing
3224 * --bar show progress as a progress bar compatible with zenity.
3226 * --resume can now be used with --result: Jobs already run will be
3229 * --transfer and --basefile support paths relative to the --workdir by
3230 inserting /./ into the path.
3232 * GNU Parallel was cited in: fastphylo: Fast tools for phylogenetics
3233 http://www.biomedcentral.com/1471-2105/14/334/abstract
3235 * Using GNU parallel
3236 http://davetang.org/muse/2013/11/18/using-gnu-parallel/
3238 * Techlux - GNU - Parallel (German)
3239 https://techlux.de/blog/2013/11/07/gnu-parallel/
3241 * awk, sed, bzip2, grep, wc на всех ядрах
3242 http://vk.com/page-30666517_45528467
3244 * 如何利用多核CPU來加速你的Linux命令 — awk, sed, bzip2, grep, wc等
3245 http://www.hksilicon.com/kb/articles/290543/CPULinuxawk-sed-bzip2-grep-wc
3247 * GNU Parallel (Japanese)
3248 http://jarp.does.notwork.org/diary/201311b.html#20131117
3250 * Bug fixes and man page updates.
3255 * --transfer files with /./ in the path will copy the files relative
3258 * The maximal command length is now cached in a file halfing the
3261 * GNU Parallel was cited in: Investigating speaker gender using rhythm
3262 metrics in Arabic dialects
3263 http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6602389
3265 * GNU Parallel was cited in: Tiedon erist ̈minen ja visualisointi a
3266 lastensuojelun asiakaskertomuksista
3267 https://tampub.uta.fi/handle/10024/84978
3269 * Some Additional Useful Bioinformatics Software
3270 http://nix-bio.blogspot.dk/2013/10/additional-software-for-bioinformatics.html
3272 * GNU Parallel Example Screen Cast (bil to Geotiff conversion)
3273 http://www.youtube.com/watch?v=PpF27eC7Mys
3275 * Using GNU Parallel to roll-your-own Map Reduce!
3276 http://www.rankfocus.com/hello-world/
3278 * Use multiple CPU Cores with your Linux commands
3279 http://www.rankfocus.com/use-cpu-cores-linux-commands/
3281 * Using GNU Parallel at HPC @ Uni.lu
3282 https://hpc.uni.lu/users/use_cases/
3284 * Scaling up with parallelization
3285 https://www.msi.umn.edu/sites/default/files/AdvPython_1.pdf
3287 * How to teach yourself to be a technical tester
3288 http://infiniteundo.com/post/62421363463/qa-toc
3290 * Faster Rasters For All
3291 http://2013.foss4g.org/conf/programme/presentations/52/
3293 * Optimizing translated file downloads
3294 http://www.smartling.com/blog/2013/05/20/optimizing-translated-file-downloads/
3296 * EMC NetWorker parallel saveset cloning with nsrclone and GNU parallel
3297 http://www.beebotech.com.au/2013/10/emc-networker-parallel-saveset-cloning-with-nsrclone-and-gnu-parallel/
3299 * Best Practices for Amazon EMR
3300 http://media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf
3302 * Computing checksums for backup
3303 https://identi.ca/evan/note/6yf1GzAARtyBhj__xzMvAg
3305 * Un exemplu de utilizare a programului GNU parallel
3306 http://vundicind.blogspot.dk/2013/10/exemplu-utilizare-gnu-parallel.html
3309 http://www.slideshare.net/drakeguan/part1-23705978
3311 * なんか気持ちよかです Gnu Parallel
3312 http://a3-lab.jpn.org/note/%E3%81%AA%E3%82%93%E3%81%8B%E6%B0%97%E6%8C%81%E3%81%A1%E3%82%88%E3%81%8B%E3%81%A7%E3%81%99-gnu-parallel
3314 * Bug fixes and man page updates.
3319 * PDF-files of documentation is now included.
3321 * Cloning at warp speed 100 VMs in 1 minute using one command line
3322 http://www.beebotech.com.au/tag/command-line/
3324 * Calcul Quebec's introduction to GNU Parallel
3325 https://wiki.calculquebec.ca/w/GNU_parallel
3327 * Brincando com o GNU parallel
3328 http://blog.tadeucruz.com/2013/09/brincando-com-o-gnu-parallel/
3330 * GNU Parallelで並列処理を行う
3331 http://qiita.com/PENGUINANA_/items/af27a833e835fe17f09b
3333 * Bug fixes and man page updates.
3338 * A tutorial showing much of GNU Parallel's functionality. Spend an
3339 hour walking through the tutorial. Your commandline will love you
3340 for it. man parallel_tutorial
3342 * --line-buffer will buffer output on line basis. --group keeps the
3343 output together for a whole job. --ungroup allows output to mixup
3344 with half a line coming from one job and half a line coming from
3345 another job. --line-buffer fits between these two; it prints a full
3346 line, but will allow for mixing lines of different jobs.
3348 * --record-env records all variables and functions set. Useful to
3349 record the normal environment before using --env _.
3351 * --env _ exports all functions and variables to the remote server
3352 except for the ones recorded.
3354 * New signing key. Due to recommendations from NIST
3355 http://www.keylength.com/en/4/ the signing key was changed from
3356 1024D/ID:FFFFFFF1 to 9888R/ID:88888888.
3358 * Agalma: an automated phylogenomics workflow
3359 http://arxiv.org/pdf/1307.6432
3361 * Job ad asking for GNU Parallel expertise
3362 http://seattle.craigslist.org/est/sof/4006079352.html
3364 * Transient Beowulf Clustering with GNU Parallel and SSHfs
3365 http://www.reddit.com/r/linux/comments/1ka8mn/transient_beowulf_clustering_with_gnu_parallel/
3367 * Aligning to unique regions
3368 http://davetang.org/muse/2013/07/22/aligning-to-unique-regions/
3370 * Top 10 scripting tricks for basic bioinformatics
3371 http://students.washington.edu/bowmanjs/wordpress/?p=873
3373 * Using GNU Parallel to speed up and simplify data analyzes
3374 http://www.sergeymarkov.com/blog/2013/07/using-gnu-parallel-to-speed-up-and-simplify-data-analyzes/
3376 * Compression of files in parallel using GNU parallel
3377 http://codextechnicanum.blogspot.dk/2013/07/compression-of-files-in-parallel-using.html
3379 * Using GNU Parallel with Amazon
3380 media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf
3382 * Some useful comments on GNU Parallel
3383 https://news.ycombinator.com/item?id=6209767
3385 * Using GNU Parallel to count reads mapping to genes for multiple BAMs
3386 http://drduanehassane.com/blog/sequencing-resources
3388 * TimeMachineっぽいバックアップスクリプト
3389 http://rio.tc/2013/07/timemachine-1.html
3391 * GNU ParallelでAndroid NDKの全バージョンを一括ダウンロード
3392 http://qiita.com/mazgi/items/b10bf0ff3da2045d19ab
3394 * Bug fixes and man page updates.
3399 * --round-robin with --pipe will write all blocks to already running
3402 * --env can now transfer Bash function for remote execution. That is
3405 * GNU Parallel was used (unfortunately with improper citation) in:
3406 Understanding the Impact of E-Commerce Software on the Adoption of Structured Data on the Web
3407 http://link.springer.com/chapter/10.1007/978-3-642-38366-3_9#page-1
3409 * GNU Parallel was used (unfortunately with improper citation) in:
3410 CWI at TREC 2012, KBA track and Session Track
3411 http://trec.nist.gov/pubs/trec21/papers/CWI.kba.session.final.pdf
3413 * Mitigation of Adverse Effects Caused by Shock Wave Boundary Layer
3414 Interactions through Optimal Wall Shaping.
3415 http://arc.aiaa.org/doi/abs/10.2514/6.2013-2653
3417 * Using GNU parallel to convert images.
3418 http://www.brunokim.com.br/blog/?p=18
3420 * A quick way to parallelize.
3421 http://timotheepoisot.fr/2013/07/08/parallel/
3423 * GNU Parallel 20130522 ('Rana Plaza') 发布,并行作业执行.
3424 http://www.open-open.com/news/view/371301
3426 * Quite a few bug fixes and man page updates.
3431 * --xapply now recycles arguments if an input source has more
3432 arguments than others.
3434 * The sleep time between jobs is now both increased and decreased
3437 * 10 seconds installation check the signature using GnuPG if GnuPG is
3440 * Developer job asking for GNU Parallel expertise.
3441 http://careers.stackoverflow.com/jobs/35562/developer-big-data-geo-and-web-climate-central
3443 * A small utility program to run youtube-dl in parallel.
3444 https://github.com/dlh/youtube-dl-parallel
3446 * Parallelizing Freesurfer:
3447 http://blog.cogneurostats.com/?p=148
3449 * Bug fixes and man page updates.
3454 * --ctrlc is now default if --pipe is not used; thus making it
3455 possible to kill remotely started jobs simply by pressing Ctrl-C.
3457 * --timeout 200% now means kill jobs that take more than twice the
3458 time of the median run time of a job.
3460 * Jobs are now distributed round robin when having mulitiple
3461 --sshlogin instead of filling up one --sshlogin at a time.
3463 * niceload: darwin version of --io --mem --swap. Thanks to Anders F
3466 * Bug fixes and man page updates.
3471 * 10 seconds installation: wget -O - pi.dk/3 | sh
3473 * HPUX CPU/core detection. Thanks to Javier Tarradas.
3475 * CPU detection for HURD, IRIX, SCO OpenServer and (old) HPUX.
3477 * --ctrlc will send SIGINT to tasks running on remote computers and
3480 * --load now uses 'ps' to see immediately see the number of running
3481 processes instead of 'uptime' thus making --load react much faster.
3483 * Testing on Centos 3.9 and FreeBSD 7 revealed a lot of compability
3484 bugs. Some of these required quite extensive changes making this
3485 release beta quality.
3487 * --retries works with --onall.
3489 * The new --load computation now works on FreeBSD 7.
3491 * --nice works under tcsh.
3493 * GNU Parallel is officially supported in NetBSD.
3494 http://ftp.netbsd.org/pub/pkgsrc/current/pkgsrc/parallel/parallel/README.html
3496 * GNU Parallel is accepted for openSUSE.
3497 http://software.opensuse.org/package/gnu_parallel
3499 * GNU Parallel can be installed under Microsoft Windows (CygWin).
3500 http://blogs.msdn.com/b/hpctrekker/archive/2013/03/30/preparing-and-uploading-datasets-for-hdinsight.aspx
3502 * Excuses for not installing GNU Parallel.
3503 http://oletange.blogspot.dk/2013/04/why-not-install-gnu-parallel.html
3505 * Job advert that requires GNU Parallel competence.
3506 http://versium.com/about/careers/
3508 * Parallelizing Batch Jobs for Fun and Profit.
3509 http://mikeseidle.com/tech/programming/2013/03/parallelizing-batch-jobs
3511 * Processing Transcription Start Sites(TSS) for the entire Mouse genome.
3512 http://qbrc.swmed.edu/2013/03/gnu-parallel-speeding-up-unix-commands-and-scripts/
3514 * GNU parallel is used throughout Scrimer.
3515 http://scrimer.readthedocs.org/en/latest/
3517 * GNU Parallel helped making public documents searchable.
3518 http://danpalmer.me/blog/articles/2013-04-06-unlocking-hillsborough.html
3520 * Identifying big movie files (German).
3521 http://blackappsolutions.wordpress.com/2013/03/23/wenn-der-plattenplatz-knapp-wird-filme-identifizieren-die-viel-platz-belegen/
3523 * Bug fixes and man page updates.
3528 * --resume works with --pipe.
3530 * --resume-failed will go through --joblog, redo the failed jobs and
3531 then continue like --resume.
3533 * Negative positional arguments count from the end: {-1} means the
3534 last argument, {-2} the second to last.
3536 * NetBSD CPU detection.
3538 * --blocksize increases exponentially if it smaller than a full
3541 * Processing n-line records (--pipe -L n) is now much faster.
3543 * --tollef is obsoleted after discussion on the mailing list.
3545 * GNU Parallel is the highest rated tool on:
3546 http://www.biostars.org/show/tools/?sort=votes&since=all%20time
3548 * GNU Parallel was loved during FSFE's #ilovefs campaign.
3549 http://fsfe.org/news/2013/news-20130212-01.en.html
3551 * Using GNU Parallel with s3cmd (Japanese).
3552 http://blog.suz-lab.com/2013/02/s3cmd-gnu-paralells3.html
3554 * Intro to GNU Parallel (Chinese).
3555 http://guiquanz.github.com/2013/02/12/gnu-parallel-intro/
3557 * Bug fixes and man page updates.
3562 * --sshdelay Delay starting next ssh by secs seconds. GNU parallel
3563 will pause secs seconds after starting each ssh. secs can be less
3566 * Official OpenBSD port:
3567 http://ftp.openbsd.org/ports/sysutils/parallel/
3569 * Official DragonFlyBSD package:
3570 http://www.mirrorservice.org/sites/ftp.dragonflybsd.org/packages/amd64/DragonFly-3.0.0/stable/parallel/
3572 * Post about niceload in Hungarian:
3573 http://commandline.blog.hu/2013/01/02/niceload
3575 * 自炊スキャンデータをKobo Gloに最適化
3576 http://interstadial.wordpress.com/2013/01/20/
3578 * GNU parallel+ssh で複数のリモートホストに複数のコマンドを実行させる
3579 http://oshiire.to/archives/1686
3581 * Bug fixes and man page updates.
3586 * --shebang-wrap makes is possible to parallelize scripts by putting
3587 parallel in the shebang line (the first #! line in scripts).
3589 * --delay puts in a delay after starting each job. Useful to avoid
3590 raceconditions and thundering herd problems.
3592 * --results now uses / as separator instead of TAB and thus creates
3593 subdirs. Thanks to Drew Frank.
3595 * parallel: OpenBSD CPU detection. Thanks to Michał Markowski.
3597 * niceload --sensor allows for negative numbers to signify a lower
3598 number means the limit is lower.
3600 * niceload --prg suspend a named program that is already running.
3602 * niceload multiple --pid suspend process ids that are already running.
3604 * Convertir des images avec find et imagemagick
3605 http://roger.b.over-blog.com/article-convertir-des-images-avec-find-et-imagemagick-113416637.html
3607 * Bug fixes and man page updates.
3612 * niceload --sensor makes it possible to use a program to control if a
3613 program should be suspended.
3615 * GNU Parallel was part of the justification for Nordic Free Software
3617 https://fsfe.org/news/2012/news-20121112-01.html
3619 * Dateien schneller packen und konvertieren mit GNU parallel
3620 http://www.linux-community.de/Archiv/Tipp-der-Woche/Dateien-schneller-packen-und-konvertieren-mit-GNU-parallel
3622 * Processing images from Lunar Reconnaissance Orbiter Narrow Angle
3623 Camera http://lunokhod.org/?p=774
3625 * GNU Parallel is used in types2: Type and Hapax Accumulation Curves
3626 http://www.cs.helsinki.fi/u/josuomel/types2/
3628 * GNU Parallel used in: A Hybrid Factor Analysis and Probabilistic
3629 PCA-based system for Dictionary Learning and Encoding for Robust
3631 http://www.superlectures.com/odyssey2012/lecture.php?id=8&lang=en
3632 http://www.cse.iitm.ac.in/~mrsri/ppca.pdf
3634 * Mapreduce avec parallel, cat et une redirection
3635 http://datacratic.com/site/blog/mapreduce-avec-parallel-cat-et-une-redirection
3637 * GNU Parallel for Large Batches of Small Jobs
3638 https://support.scinet.utoronto.ca/wiki/images/7/7b/Tech-talk-gnu-parallel.pdf
3640 * GNU Parallel used in black belt tip (8:50-10:12)
3641 https://aws.amazon.com/apac/awspodcast/episode20/
3643 * Bug fixes and man page updates.
3648 * --results structures output files so they can be imported using
3649 Pandas (http://pandas.pydata.org/). Useful when doing simulations to
3650 select output from some arguments.
3652 * Use --env to transfer environment variables through ssh to remote
3655 * GNU Parallel is accepted for Ubuntu Quantal.
3656 http://packages.ubuntu.com/quantal/parallel
3658 * GNU Parallel was requested for OpenSUSE (go vote!)
3659 https://features.opensuse.org/314461
3661 * Kneth's Korner: Map/Reduce and GNU Parallel
3662 http://kenneth.geisshirt.dk/2012/10/mapreduce-and-gnu-parallel.html
3664 * Blog post in Japanese by Siguniang.
3665 https://siguniang.wordpress.com/2012/09/09/notes-on-gnu-parallel-the-command-line-power-tool/
3666 (Siguniang mentions the logo is called 'The Cafe Wall Illusion')
3667 http://www.michaelbach.de/ot/ang_cafewall/index.html
3669 * GNU Parallel, where have you been all my life?
3670 http://ssdigit.nothingisreal.com/2012/09/gnu-parallel-where-have-you-been-all-my.html
3672 * Reference-free ddRADseq analysis tools uses GNU Parallel.
3673 https://github.com/brantp/rtd#readme
3675 * When bash just isn’t quick enough.
3676 https://soimasysadmin.wordpress.com/2012/08/15/gnu-parallel-when-bash-just-isnt-quick-enough/
3678 * Using GNU Parallel to Package Multiple Jobs in a Single PBS Job.
3679 http://www.nas.nasa.gov/hecc/support/kb/Using-GNU-Parallel-to-Package-Multiple-Jobs-in-a-Single-PBS-Job_303.html
3681 * GNU Parallel Notes.
3682 http://xed.ch/help/parallel.html
3684 * Bug fixes and man page updates.
3689 * Due to a bugfix the main flow has changed. Making this release beta
3692 * Parallel Proxy Scraper & Checker Tool
3693 https://www.youtube.com/watch?v=iXCeR_XsP6o
3695 * Bug fixes and man page updates.
3700 * GNU Parallel was presented at Chiang Mai Bar Camp
3701 http://barcampchiangmai.org/
3703 http://www.cnx-software.com/2012/07/02/use-gnu-parallel-to-speed-up-script-execution-on-multiple-cores-andor-machines/
3705 * I don't always max out all my CPUs, but when I do, I do it with GNU
3707 http://memegenerator.net/instance/22638454
3709 * Bug fixes and man page updates.
3714 * '-L n --pipe' will use records of n lines. This is useful when
3715 processing data that have fixed records with a fixed number of
3718 * --filter-hosts will remove down hosts. For each remote host: check
3719 that login through ssh works. If not: do not use this host.
3720 Currently you can not put --filter-hosts in a profile, $PARALLEL,
3721 /etc/parallel/config or similar. This is because GNU Parallel uses
3722 GNU Parallel to compute this, so you will get an infinite loop. This
3723 will likely be fixed in a later release.
3725 * --pipe now uses fork() instead of busy wait. The performance should
3726 be better on computers with >10 cores while remaining the same on
3727 computers with few cores.
3729 * GNU Parallel will be represented at Chiang Mai Bar Camp.
3730 http://barcampchiangmai.org/
3732 * Indexing Big Data on Amazon AWS: The Screencast
3733 (Check out his T-shirt at 18:40-21:00).
3734 http://www.opensourceconnections.com/2012/06/06/indexing-big-data-on-amazon-aws-screencast/
3736 * biotoolbox uses GNU Parallel.
3737 https://code.google.com/p/biotoolbox/wiki/Pod_novo_wrapper
3739 * Spiceweasel uses GNU Parallel.
3740 https://github.com/mattray/spiceweasel
3742 * GNU Parallel part of The Administrators Challenge.
3743 http://challenge.twistedrack.com/questions/qs3.php
3745 * Finding Oldest Firefox Code using GNU Parallel.
3746 http://gregoryszorc.com/blog/2012/06/18/finding-oldest-firefox-code/
3748 * Bug fixes (quite a few for remote job running) and man page updates.
3753 * Timings in --joblog now with milliseconds.
3755 * Thesis using GNU Parallel (correctly cited; hooray!).
3756 http://scholarworks.sjsu.edu/etd_projects/222/
3759 http://www.perzl.org/aix/index.php?n=Main.Parallel
3761 * Prokka uses GNU Parallel.
3762 http://bioinformatics.net.au/prokka-manual.html
3764 * GNU Parallel was presented at MUUG.
3765 http://muug.mb.ca/blog/meetings/2012/05/09/may-8th-2012-rtfm-gnu-parallel1/
3767 * Blog post: Manipulating many or large files with GNU parallel.
3768 http://compbiously.blogspot.com/2012/05/manipulating-many-or-large-files-with.html
3770 * Blog post: Running commands in parallel using bash.
3771 http://blog.michaelboman.org/2012/04/running-commands-in-parallel-using-bash.html
3773 * Blog post in Hungarian.
3774 http://commandline.blog.hu/2012/05/03/gnu_parallel
3776 * Popularity of GNU Parallel in Debian explodes.
3777 http://qa.debian.org/popcon-graph.php?packages=parallel
3779 * Bug fixes and man page updates.
3784 * A race condition bug caused restructuring of a central piece of the
3785 code. Thus this release of GNU Parallel should be considered beta
3788 * sql --dbsize will now list sizes of all databases if given no
3791 * GNU Parallel is now in Debian Unstable.
3792 apt-get install parallel
3794 * Article: Computational and experimental analyses of
3795 retrotransposon-associated minisatellite DNAs in the soybean genome.
3796 http://www.biomedcentral.com/content/supplementary/1471-2105-13-s2-s13-s1.pdf
3798 * Blog post: GNU parallel - the best thing since sliced bread.
3799 https://arrayal.wordpress.com/2012/03/27/gnu-parallel-the-best-thing-since-sliced-bread/
3801 * Blog post: GNU Parallel makes everything faster.
3802 http://compbiously.blogspot.com/2012/03/gnu-parallel-makes-everything-faster.html
3804 * Blog post (German): Howto: GNU parallel.
3805 http://d24m.de/2012/04/05/howto-gnu-parallel/
3807 * Blog post: Running in Parallel
3808 http://interactivity.ifactory.com/2012/04/running-in-parallel/
3810 * 20000 watched the first intro video.
3813 * The first 5 have received their GNU Parallel merchandise
3814 https://www.gnu.org/software/parallel/merchandise.html
3816 * Bug fixes and man page updates.
3821 * Parallel Process Database Dumps.
3822 http://blog.mattoates.co.uk/2012/02/parallel-process-database-dumps.html
3824 * Using GNU Parallel to process images from Mars.
3825 http://lunokhod.org/?p=468
3827 * Using GNU Parallel with bzgrep.
3828 http://filip.rembialkowski.net/did-you-know-gnu-parallel/
3830 * Bug fixes and man page updates.
3835 * --workdir . will use the current working dir. If the current working
3836 dir is beneath your home dir, the value . is treated as the relative
3837 path to your home dir. This means that if your home dir is different
3838 on remote computers (e.g. if your login is different) the relative
3839 path will still be relative to your home dir.
3841 * A texinfo file is now generated from the POD file using pod2texi.
3843 * The bioinformatics article "Fast large-scale clustering of protein
3844 structures using Gauss integrals" mentions GNU Parallel. They forgot
3845 to add the reference. Please remember --bibtex if you use GNU
3846 Parallel in an article.
3847 http://bioinformatics.oxfordjournals.org/content/28/4/510.short
3849 * The first supporter received his merchandise. Did you order yours?
3850 https://www.gnu.org/software/parallel/merchandise.html
3852 * How to use GNU Parallel with samtools.
3853 http://zvfak.blogspot.com/2012/02/samtools-in-parallel.html
3855 * How to use GNU Parallel for vacuuming PostgreSQL tables.
3856 http://blog.timmattison.com/archives/2012/01/24/mini-hack-parallel-vacuuming-in-postgresql/
3858 * Converting e-books with Calibre and GNU Parallel.
3859 http://www.linkhal.de/blog/2012/01/converting-massive-e-book-collections-with-calibre-and-gnu-parrallel/
3861 * Using GNU Parallel for tailing logfiles from multiple servers.
3862 http://silviud.blogspot.com/2012/02/shell-parallel-processing.html
3864 * Bug fixes and man page updates.
3869 * --header : uses the first input line as column names and you can
3870 then use {colname} as a replacement string in the command. This also
3871 works with multiple :::'s.
3873 * --header <regexp> matches a header as a regular expression and
3874 repeats the header for each block with --pipe.
3876 * --resume resumes from the last unfinished job. Useful if you stop
3877 GNU Parallel and restart it later with the same arguments.
3879 * niceload now propagates exit status correctly.
3881 * Show your support for GNU Parallel. For a limited time you can get a
3882 GNU Parallel T-shirt+mug+pen+100 postcards at 20 EUR. See
3883 https://www.gnu.org/software/parallel/merchandise.html
3885 * Options -g -B -T -U -W -Y are retired as warned 6 months ago.
3887 * GNU Parallel referenced in article on Holographic Grid Cloud. Thanks
3888 to Stefano Gallozzi. http://arxiv.org/pdf/1112.6128
3890 * Article in IEEE Software on GNU Parallel. Thanks to Diomidis
3891 Spinellis. http://www.spinellis.gr/blog/20110911/
3893 * An article on Narwhal which uses GNU Parallel. They forgot to add
3894 the reference. Please remember --bibtex if you use GNU Parallel in
3896 http://bioinformatics.oxfordjournals.org/content/early/2011/11/08/bioinformatics.btr613.full.pdf
3898 * Blog post on using GNU Parallel to speed up BLAST queries:
3899 http://blog.mckuhn.de/2012/01/embarrassingly-parallel-blast-search.html
3901 * Video showing Wake-on-LAN with GNU Parallel.
3902 https://www.youtube.com/watch?v=0mB-yIyKFLQ
3904 * Using GNU Parallel with Solr.
3905 http://sujitpal.blogspot.com/2011/12/solr-report-generation-with-python.html
3907 * First job ad including GNU Parallel:
3908 http://seeker.dice.com/jobsearch/servlet/JobSearch?op=101&dockey=xml/7/6/76f858de083a094f74b1a5d3ba53ffc5@endecaindex
3910 * Bug fixes and man page updates.
3915 * --timeout will now kill grandchildren.
3917 * Interview in Hacker Public Radio.
3918 http://hackerpublicradio.org/eps.php?id=0860
3920 * Blog post in Chinese.
3921 http://blog.sina.com.cn/s/blog_3f7652740100y0ju.html
3923 * Bug fixes and man page updates.
3928 * GNU Parallel package for Fedora.
3929 https://admin.fedoraproject.org/pkgdb/acls/name/parallel
3931 * Using GNU Parallel with Mozilla cross referencing.
3932 https://blog.mozilla.com/it/2011/11/15/mxr-improvements/
3934 * Neat flash presentation of GNU Parallel.
3935 http://prezi.com/0nq74b2elgtx/about-gnu-parallel/
3937 * How to create tar files of dirs in parallel.
3938 https://joneslee85.wordpress.com/2011/11/22/shell-tips-how-to-recursively-archive-many-folders/
3940 * Article in Admin Network&Security by Ben Martin.
3941 http://www.admin-magazine.com/HPC/Articles/GNU-Parallel
3943 * Blog post in Polish.
3944 http://blog.tiger.com.pl/2011/01/05/gnu-parallel/
3946 * Blog post on using GNU Parallel of Mac OS X.
3947 http://www.0xcb0.com/2011/10/19/running-parallel-bash-tasks-on-os-x/
3949 * Blog post in English by researcher.
3950 http://zandyware.wordpress.com/2011/10/15/gnu-parallell-make-best-use-of-your-multicore-computer/
3952 * Blog entry in Chinese.
3953 http://blog.csdn.net/tossense/article/details/6889026
3955 * Blog entry in Japanese on managing many servers.
3956 http://hiroakis.com/blog/2011/11/13/gnu-parallel/
3958 * GNU Parallel is now part of ppbs.
3959 http://physiology.med.cornell.edu/faculty/mason/lab/ppbs/introduction/introduction.html
3961 * How to use GNU Parallel with MCX.
3962 http://mcx.sourceforge.net/cgi-bin/index.cgi?MMC/Doc/MMCCluster
3964 * Bug fixes and man page updates.
3969 * --tag prepends lines with the argument(s). If used with --(n)onall
3970 the line will be prepended with the sshlogin instead.
3972 * --shellquote does not run the command but quotes it using \'s.
3973 Useful for making quoted composed commands.
3975 * --profile can now be repeated merging multiple profiles.
3977 * --bibtex now gives the BibTeX entry.
3978 Thanks to Aleksandr Levchuk for testing.
3980 * Makefile for simple .deb package.
3981 cd packager/debian; make
3983 * sql: --list-databases lists the databases.
3985 * GNU Parallel officially in Fedora 16
3986 http://www.spinics.net/lists/fedora-package-announce/msg67130.html
3988 * Blog post on recompression FLAC audio.
3989 http://blog.oxplot.com/2011/08/reflac-flac-cleanser.html
3991 * The most complex use of ::: I have seen so far.
3992 http://agentzlerich.blogspot.com/2011/09/following-up-on-previous-failures-ive.html
3994 * Example of using GNU Parallel with sudo.
3995 http://loopkid.net/articles/2011/10/07/recursive-chmod-and-chown-on-files
3997 * Use wget and gnu parallel to download mp3s at rocket speed.
3998 http://sdbrain.posterous.com/use-wget-and-gnu-parallel-to-download-mp3s-at
4000 * First CV referring to GNU Parallel.
4001 http://www.peopleperhour.com/freelancers/stephen_/internet_researcher_and_protocol_develop/140602
4003 * Cartwright labs usage of GNU Parallel.
4004 http://cartwrightlab.wikispaces.com/The+Most+Bang+for+Your+Buck
4006 * Bug fixes and man page updates.
4011 * --timeout implemented so that slow commands can be killed
4013 * CPU detection improved for Mac OSX. Thanks to Wayne E. Seguin.
4015 * Example of a parallel webcrawler in the man page.
4017 * Backup up PostgreSQL with GNU Parallel. Thanks to Stephane Wirtel.
4018 http://wirtel.be/2011/07/15/rsync_parallel/
4020 * Blog post in Japanese.
4021 http://dminor11th.blogspot.com/2011/08/gnu-parallel.html
4023 * Blog post about optimizing JPEGs. Thanks to Thomas Jost.
4024 http://schnouki.net/2011/07/22/optimizing-jpeg-pictures/
4026 * Bug fixes and man page updates.
4031 * niceload: --hard will suspend a program if a limit is reached - as
4032 opposed to just slowing the program down.
4034 * niceload: --soft will slow the program down - as opposed to
4035 suspending the program completely.
4037 * niceload: --run-io will slow down a program if disk io goes above a
4040 * niceload: --run-load will slow down a program if loadaverage goes
4041 above a certain limit.
4043 * niceload: --run-mem will slow down a program if free memory goes
4044 below a certain limit.
4046 * niceload: --run-noswap will slow down a program if the computer is
4049 * niceload: --start-io, --start-load, --start-mem, --start-noswap will
4050 defer starting a program until the system is below the limit.
4052 * --io, --load, --mem, and --noswap sets both --run-* and --start-*.
4054 * niceload got a major rewrite and is now object oriented.
4056 * GNU Parallel was presented at Nordic Perl Workshop 2011.
4057 http://conferences.yapceurope.org/npw2011/talk/3416
4059 * Blog post about zcat and GNU Parallel. Thanks to Dr. John.
4060 http://drjohnstechtalk.com/blog/2011/06/gnu-parallel-really-helps-with-zcat/
4062 * 2 blog posts in Japanese. Thanks to Negima.
4063 http://d.hatena.ne.jp/negima1976/20110607/1307412660
4064 http://d.hatena.ne.jp/negima1976/20110628/1309252494
4066 * Blog post for bioinformatics. Thanks to Chris Miller.
4067 http://chrisamiller.com/science/2010/05/26/use-parallel-for-easy-multi-processor-execution/
4069 * Bug fixes and man page updates.
4074 * --onall will run all the jobs on all the computers. This is useful
4075 for systemadinistrators having multiple servers.
4077 * --nonall runs like --onall but reads no arguments from stdin
4078 (standard input), so is possible to do:
4079 parallel --nonall -S computer1,computer2 uptime
4081 * Context replace now works with multiple input sources:
4082 parallel -X echo {1}-{2} ::: 1 2 3 ::: a b c
4084 * --noswap do not start a job on a server that is swapping.
4086 * Article: Parallel processing without Hadoop!
4087 http://www.solutionhacker.com/parallel-processing-without-hadoop/
4089 * Article in Linux Magazine (Spanish). Thanks to Ben Martin.
4090 http://www.linux-magazine.es/issue/67/
4092 * First blog post in Korean. Thanks to 민병국.
4093 http://blog.daum.net/_blog/BlogTypeView.do?blogid=02RQ3&articleno=13380895&admin=#
4095 * Blog post in Japanese. Thanks to Naoya Nakazawa.
4096 http://www.sssg.org/blogs/naoya/archives/2003
4098 * Blog post in English. Thanks to Dagon.
4099 http://hekate.homeip.net/2011/05/29/
4101 * Bug fixes and man page updates.
4106 * Multiple ::: can be put on the command line and will be treated
4107 similar to contents from multiple -a's.
4109 * ::: and :::: can now be mixed on the command line. Use {1} .. {n} to
4110 refer to inputs from the different input sources.
4112 * --xapply is now needed to get xapply's behaviour of reading one line
4113 from each of the input sources.
4115 * Multiple input sources will cause all combinations of arguments from
4116 the sources to be generated. E.g. 'parallel echo {1}+{2} ::: 1 2 :::
4117 a b c' will print 1+a 1+b 1+c 2+a 2+b 2+c. This can often replace
4120 * Implemented {//} for the input line with the basename removed (dirname).
4122 * New video showing the new ::: and :::: input sources.
4123 http://tinyogg.com/watch/iOdhU/ http://www.youtube.com/watch?v=fOX1EyHkQwc
4125 * GNU Parallel now has a logo.
4126 http://www.gnu.org/software/parallel/logo.png
4128 * Article about GNU SQL in USENIX Magazine ;login: (print)
4129 http://www.usenix.org/publications/login/2011-04/
4131 * Using GNU Parallel with EC2. Thanks to Kevin Wu.
4132 http://blog.kevinformatics.com/post/4970574713/interested-in-your-experience-using-gnu-parallel-in
4134 * Review with idea for {..} and {...} in Japanese. Thanks to ichii386.
4135 http://d.hatena.ne.jp/ichii386/20110426
4137 * Upgrade GNU Parallel using Macports. Thanks to Phil Hollenback.
4138 http://www.hollenback.net/index.php/MacportsParallel
4140 * Robert from Echo One discusses using processes instead of threads:
4141 http://rrees.wordpress.com/2011/04/25/many-cores-many-threads/
4143 * How to run GNU Parallel on a SLURM cluster. Thanks to Kevin Stock.
4144 http://www.kevinstock.org/2011/04/using-the-ri-cluster/
4146 * Short article about using GNU Parallel with lame:
4147 http://loopkid.net/articles/2011/04/30/accelerate-lame-mp3-conversion
4149 * Using GNU Parallel to run tail -f in Japanese. Thanks to Clouder.
4150 http://blog.clouder.jp/archives/001140.html
4152 * BBC Research & Development uses GNU Parallel:
4153 http://www.bbc.co.uk/blogs/researchanddevelopment/2010/11/prototyping-weeknotes-41-26112.shtml
4155 * Short article about using GNU Parallel on RHEL. Thanks to Rishi Deshpande.
4156 http://nuclear-imaging.info/site_content/2011/05/11/gnu-parallel/
4158 * Using GNU Parallel for FLAC->MP3 conversion. Thanks to Derek Marcotte.
4159 http://derek.chezmarcotte.ca/?p=286
4161 * Bug fixes and man page updates.
4166 * {#} now works as an alias for $PARALLEL_PID.
4168 * --eta now estimates way more accurately.
4170 * CPU detection code for AIX thanks to Christian Netrwal.
4172 * --joblog contains exitcode.
4174 * Thanks to Ævar Arnfjörð Bjarmason for reading my code.
4176 * GNU Parallel was presented at:
4177 - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm
4178 - OSAA.dk, Aarhus, 2011-04-12
4180 * Blog entry in Japanese. Thanks to Riywo.
4181 http://blog.riywo.com/2011/04/19/022802
4183 * Example of how to use GNU Parallel on PBS clusters. Thanks to Andrew
4184 J Dolgert: http://web0.tc.cornell.edu/wiki/index.php?title=Gnu_Parallel
4186 * First example of using GNU Parallel in Hebrew. Thanks to omry.
4189 * Intro video got past 10000 hits.
4190 http://www.youtube.com/watch?v=OpaiGYxkSuQ
4192 * Bug fixes and man page updates.
4197 * --tollef to be switch compatible with Tollef's parallel. This will
4198 cause -l to mean --load, and the argument separator will be --
4201 * --gnu will force GNU Parallel to behave like GNU Parallel even if
4204 * Site wide config file: /etc/parallel/config
4206 This should solve the issue with some packagers renaming GNU
4207 Parallel to gparallel to avoid the naming conflict.
4209 By putting --tollef in the site wide config file you can deinstall
4210 Tollef's parallel and install GNU Parallel instead without any
4211 change for users or scripts. This is useful for packagers that
4212 currently rename GNU Parallel or simply do not distribute GNU
4213 Parallel because the command name conflicts with Tollef's parallel.
4215 * -L 0 -n 0, and -N 0 implemented. They will read one argument,
4216 but insert 0 arguments on the command line. Useful if you just want
4217 to run the same command with the same arguments a number of times.
4219 * GNU Parallel is now in Fink. Thanks to Jesse Alama.
4220 http://pdb.finkproject.org/pdb/package.php/parallel
4222 * Opscode Cookbook for Chef. Thanks to Joshua Timberman.
4223 https://github.com/opscode/cookbooks/tree/master/gnu_parallel
4225 * Man page examples translated into Japanese. Thanks to Koshigoe.
4226 http://w.koshigoe.jp/study/?%5Bsystem%5D+GNU+parallel+%BB%C8%CD%D1%CE%E3#l13
4228 * GNU Parallel will be presented at:
4229 - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm
4230 - OSAA.dk, Aarhus, 2011-04-12
4232 * Video of presentation from FSCONS 2010-11-07. The presenter was
4233 _really_ hoarse that day (Something to do with loads of alcohol the
4234 night before). http://vimeo.com/20838834
4236 * Review with examples in German. Thanks to M. Nieberg.
4237 http://kenntwas.de/2011/linux/gnu-parallel/
4239 * A review of the --pipe option in German. Thanks to Mathias Huber.
4240 http://www.linux-magazin.de/NEWS/GNU-Parallel-20110205-stueckelt-Daten
4242 * A small example of grepping maillogs. Thanks to François Maillet.
4243 http://www.francoismaillet.com/blog/?p=399
4245 * Using GNU Parallel instead of xargs. Thanks to James Cuff.
4246 http://blog.jcuff.net/2011/02/on-train-ride-in.html
4248 * Bug fixes and man page updates.
4253 * --pipe splits piped data into blocks. Each block is piped to a
4254 program for processing. The piping and the programs will be run in
4255 parallel. Useful if the data you want to process is data for a
4256 program and not arguments.
4258 * --blocksize sets the blocksize in bytes for --pipe. The blocksize is
4259 approximate. It can deviate as much as the size of one record.
4262 * --recstart sets the string matching the start of a
4263 record. Default is "".
4265 * --recend sets the string matching the end of a
4266 record. Default is '\n'. To specify none use --recend "".
4268 If both --recstart and --recend are set, the end of a record must be
4269 followed immediately by a start of a record. This is useful if
4270 either recend or recstart can occur in the middle of a record.
4272 * --remove-rec-sep removes the string matched by --recstart and
4275 * --regexp will make GNU Parallel treat --recstart and --recend as
4276 regular expressions.
4278 * --output-as-files will put the output of the programs into files and
4279 instead of giving the output GNU Parallel will output the name of
4282 * -N if used with --pipe sets the number of records to read.
4284 * New video showing --pipe at
4285 http://www.youtube.com/watch?v=1ntxT-47VPA
4287 * GNU Parallel was presented at FOSDEM.
4289 * Article in USENIX Magazine ;login: (print)
4290 http://www.usenix.org/publications/login/2011-02/
4292 * GNU Parallel is now on ohloh.net. Thanks to Wim Muskee.
4293 https://www.ohloh.net/p/gnu-parallel
4295 * Advanced recursive example. Thanks to Ruarí Ødegaard.
4296 http://my.opera.com/ruario/blog/2011/01/24/editing-debian-packages-more-fun-with-gnu
4298 * Small example on using GNU Parallel through 0install (German).
4299 http://forum.ubuntuusers.de/topic/gnu-parallel-mit-zero-install-kurzinfo-kein-wi/
4301 * Bug fixes and man page updates.
4306 * --joblog makes a simple log of completed jobs.
4308 * -X now spreads arguments between job slots when reaching last
4309 argument. Use -j1 to avoid this.
4311 * People on the email list have voted -j+0 to be the new default
4314 * First review in Polish. Thanks to Patryk Krawaczyński.
4315 http://nfsec.pl/root/2458
4317 * Review in Spanish (in print).
4318 https://www.linux-magazine.es/issue/67/moreinfo.html
4320 * Review in English. Thanks to Brian Gough.
4321 http://blogs.fsfe.org/bjg/2011/01/gnu-parallel-a-map-operator-for-the-command-line/
4323 * Review in French. Thanks to Denis Dordoigne.
4324 http://linuxfr.org/2010/12/29/27715.html
4326 * Review in Spanish.
4327 http://gufete.net/index.php?entry=entry110116-200022
4329 * Article with advanced recursive example. Thanks to Ruarí Ødegaard
4330 http://my.opera.com/ruario/blog/2011/01/18/fun-with-gnu-parallel
4332 * Use case for memcache.
4333 http://www.dctrwatson.com/2010/12/how-to-dump-memcache-keyvalue-pairs-fast/
4335 * Bug fixes and man page updates.
4340 * GNU niceload is now part of GNU Parallel. GNU niceload slows down a
4341 program if the load average is above a certain limit.
4343 * Implemented --tmpdir to buffer standard output and standard error in
4346 * Implemented --load to wait until the load is below a limit before
4347 starting another job on that computer.
4349 * Implemented --nice set the niceness of jobs running both locally and
4352 * Implemented --dry-run to print the job without running it.
4354 * Implemented --tty as the old default of assigning a tty to the first
4355 job causes problems.
4357 * Review with focus on clusters. Thanks to Taylor Gillespie
4358 http://www.unixpronews.com/unixpronews-49-20101019GNUParallelSpeedUpProcessingWithMulticoresClusters.html
4360 * Review with focus on protein similarity.
4361 http://kevinformatics.tumblr.com/post/2142473893/cluster-like-computing-using-gnu-parallel
4363 * Review in Spanish.
4364 http://gr3p.com/2010/12/gnu-parallel-acelera-tus-scripts-en-linux
4366 * Quite a few bug fixes and man page updates.
4371 * Implemented {/} for the input line with the path removed (basename).
4373 * Implemented {/.} for the input line with extension and path removed
4376 * Output from --progress is now sent to standard error instead of
4379 * --eta was broken and counted down from 0. Now fixed.
4381 * Standard output and standard error are flushed after every job so if
4382 standard output does not end with a newline it will still be grouped
4383 with the rest of standard output.
4385 * --command, -c, --file, and -f are now removed as options. They were
4386 never used in practice.
4388 * GetOptionsFromArray rewritten to work with old Perl libraries.
4390 * The file COPYING now contains the GNU General Public License 3
4392 * Major rewrite to make the code more object oriented and easier to
4393 maintain in the future.
4398 * Using -j myfile the number of jobs can be changed while GNU Parallel
4399 is running simply by changing the content of myfile.
4401 * Implemented --profile to use different .parallel/config for
4402 different situations.
4404 * Ugly newlines in $PARALLEL and .parallel/config are no longer
4405 needed. Instead you have to use \ in front of special shell
4408 * --workdir puts the files transferred to remote machines in a
4409 specified directory.
4411 * $PARALLEL_PID is set to the process id of GNU Parallel.
4413 * $PARALLEL_SEQ is set to the sequence number of the job.
4415 * -v now only shows the command to run. Use -v -v to show the
4418 * Slow spawning error is now only a warning.
4420 * If stdin is a tty and input is read from stdin you now get a
4423 * GNU sql: \n and \x0a in arguments is replaced with newline.
4425 * Patch for Debian package and spelling mistakes. Thanks to Rogério
4426 Brito <rbrito at ime dot usp dot br>
4428 * Mac OS X Homebrew package. Thanks to Jonathan Palardy <jonathan dot
4429 palardy at gmail dot com>
4431 * FreeBSD port. Thanks to Chris Howey <howeyc at gmail dot com>
4433 * Pardus package. Thanks to Fethican Coşkuner
4434 <fethicanc at gmail dot com>
4436 * First review in Chinese. Thanks to 曾義峰:
4437 http://antbsd.twbbs.org/~ant/wordpress/?p=2876
4439 * First review in print:
4440 http://www.linux-magazine.com/Issues/2010 Nov 2010
4442 * First review in Spanish:
4443 http://www.muylinux.com/2010/10/18/gnu-parallel-computacion-paralela-a-golpe-de-comando
4445 * First review in Dutch thanks to Koen Vervloesem <koen at vervloesem
4447 http://techworld.nl/technologie/33493/gebruik-al-je-processorkernen-met-gnu-parallel.html
4449 * Blog review thanks to R. Tyler Croy <tyler at monkeypox dot org>:
4450 http://unethicalblogger.com/posts/2010/11/gnuparallel_changed_my_life
4452 * 5000 views of the intro video:
4453 http://www.youtube.com/watch?v=OpaiGYxkSuQ
4455 * As usual a bunch of bugfixes and more usage examples in the man
4458 * GNU Parallel was presented at FSCONS 2010-11-07:
4459 http://www.fscons.org/fs/gnu-parallel Hopefully the
4460 video will be online soon.
4465 * See GNU Parallel live at FSCONS 2010-11-07:
4466 http://www.fscons.org/fs/gnu-parallel
4468 * Untested Debian and xUbuntu packages available through OpenSUSE
4470 https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
4472 * Using --retries a job will be retried on another computer if it
4473 fails. This is useful if some jobs fail for no apparent reason (such
4474 as network failure).
4476 * BSD xargs -o (open /dev/tty) is now default for the job running in
4477 foreground. Useful for interactive commands like:
4478 ls | parallel -Xuj1 vi
4480 * GNU sql now supports SQLite.
4482 * Renamed .dburl.aliases to .sql/aliases and /etc/sql/aliases.
4484 * GNU sql now support --list-tables
4486 * Alias for DBURL can contain '?query' part with %-quoting.
4491 * Using --shebang GNU Parallel can be used as the parser for a script.
4492 E.g: #!/usr/bin/parallel --shebang traceroute (followed by lines of
4495 * First community generated bugfixes
4497 * Alt Linux package of GNU Parallel. Thanks to Michael Shigorin <mike
4498 at altlinux dot org>
4500 * Sunfreeware package of GNU Parallel. Thanks to Steven M. Christensen
4501 <sunfreeware at gmail.com>
4503 * Untested CentOS, Fedora, Mandriva, RedHat, and SUSE packages
4504 available through OpenSUSE build service:
4505 https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
4507 * Review of GNU Parallel. Thanks to Andrew McFague amcfague at wgen dot net
4508 http://www.andrew-mcfague.com/linux/utilities-linux/
4509 commands-every-serious-nix-user-should-know/#parallel
4511 * First 1000 views of the intro video
4513 * sql - a small script to access sql bases from the command line which
4514 is a handy companion to parallel --colsep
4519 * Counting semaphore functionality: start a job in the background. If
4520 N jobs are already running, wait for one to complete. Examples:
4521 sem 'sleep 2; echo foo'; sem 'sleep 1; echo bar'; sem --wait
4522 sem -j2 'sleep 2; echo foo'; sem -j2 'sleep 1; echo bar'; sem --wait
4524 * With --colsep a table can be used as input. Example:
4525 cat tab_sep_table | parallel --colsep '\t' echo col1 {1} col2 {2}
4527 * --trim can remove white space around arguments.
4529 * --sshloginfile '..' means use ~/.parallel/sshloginfile
4531 * Zero install package. Thanks to Tim Cuthbertson <tim3d dot junk at
4534 * OpenSUSE package. Thanks to Markus Ammer <mkmm at gmx-topmail dot
4537 * NixOS package. Thanks to Ludovic Courtès <ludo at gnu dot org>
4539 * Web review http://oentend.blogspot.com/2010/08/gnu-parallel.html
4540 Thanks to Pavel Nuzhdin <pnzhdin at gmail dot com>
4542 * Web review http://psung.blogspot.com/2010/08/gnu-parallel.html
4543 Thanks to Phil Sung <psung at alum dot mit dot edu>
4548 * Arguments can now be given on the command line. Example:
4549 parallel bzip2 ::: *.txt
4551 * xapply like functionality. Example:
4552 parallel diff {1} {2} :::: filelist1 filelist2
4553 parallel diff {1} {2} ">"{1.}-{2.}.diff :::: filelist1 filelist2
4555 * Arch Linux package. Thanks to Peter Simons <simons at cryp dot to>
4557 * Mandriva package. Thanks to Sandro Cazzaniga <kharec at mandriva dot
4560 * -L -l -n -s now implies -X unless -m is set
4565 * New video showing the new options.
4566 http://www.youtube.com/watch?v=OpaiGYxkSuQ or at
4567 http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/
4569 * 100% options complete with xargs. All options for xargs can now be
4570 used in GNU Parallel - even the more exotic.
4572 * --basefile for transferring basedata. When running jobs on remote
4573 computers --basefile will transfer files before the first jobs is
4574 run. It can be used to transfer data that remains the same for each
4575 job such as scripts or lookup tables.
4577 * --progress shows progress. To see how many jobs is running on each
4578 server use --progress. It can be turned on even after GNU Parallel
4581 * --eta shows estimated time left in seconds.
4583 * --halt-on-error stops if an error occurs. GNU Parallel will default
4584 to run all jobs - even if some of them fail. With --halt-on-error
4585 GNU Parallel can ignore errors, wait for the currently running jobs
4586 to finish, or stop immediately when an error occurs.
4591 * GNU Parallel now has support for running jobs on remote machines
4593 * Intro video http://www.youtube.com/watch?v=LlXDtd_pRaY
4594 http://openvideo.dailymotion.com/video/xdmqwz_gnu-parallel-script-processing-and_tech
4599 * GNU Parallel is now official GNU software