5 * --sshlogin supports ranges: server[01-12,15] 10.0.[1-10].[2-254]
7 * --plus enables {slot-1} and {seq-1} = {%}-1 and {#}-1 to count from 0.
9 * env_parallel.{sh,ash,dash,bash,ksh,zsh} is now the same script.
11 * Bug fixes and man page updates.
18 * --combine-exec combines GNU Parallel with any executable.
20 * Bug fixes and man page updates.
22 News about GNU Parallel:
24 * The first GNU Parallel video that seems to be completely AI
25 generated: https://www.youtube.com/watch?v=Ie8eAhlEHOg
27 * GNU Parallel and “fail immediately if any fails” problem
28 https://antiarchitect.medium.com/gnu-parallel-and-fail-immediately-if-any-fails-problem-481ddea690ba
35 * -a file1 -a +file2 will link file2 to file1 similar to ::::+
37 * --bar shows total time when all jobs are done.
39 * Bug fixes and man page updates.
41 News about GNU Parallel:
43 * Using GNU Parallel in bash scripts to optimize python processes
44 https://climate-cms.org/posts/2023-11-02-gnu-parallel.html
51 * Bug fixes and man page updates.
53 News about GNU Parallel:
55 * Resume long parallel jobs
56 https://ginolhac.github.io/posts/2023-10-02_resume-parallel/index.html
58 * Efficiency and Speed with GNU Parallel
59 https://dev.to/0xog_pg/efficiency-and-speed-with-gnu-parallel-loo
66 * Bug fixes and man page updates.
68 News about GNU Parallel:
70 * This CLI Tool is AMAZING | Prime Reacts
71 https://www.youtube.com/watch?v=ry49BZA-tgg
73 * New Data Engineering Stack - GNU parallel
74 https://www.linkedin.com/feed/update/urn:li:activity:7100509073149743104?updateEntityUrn=urn%3Ali%3Afs_feedUpdate%3A%28V2%2Curn%3Ali%3Aactivity%3A7100509073149743104%29
81 * Bug fixes and man page updates.
83 News about GNU Parallel:
85 * GNU Parallel, where have you been all my life?
86 https://alexplescan.com/posts/2023/08/20/gnu-parallel/
88 * Parallel (multithreaded) music download from Youtube
89 https://hrna.moe/?p=parallel-multithread-music-download
96 * Time functions (e.g. yyyymmdd($secs) ) can now take secs since epoch as argument.
98 * Bug fixes and man page updates.
105 * Bug fixes and man page updates.
107 News about GNU Parallel:
109 * Run faster in the terminal with Gnu Parallel https://www.youtube.com/watch?v=fSYVYsKXWP0
111 * Building an (Evil) Android Phone Bot Army http://blog.faucher.net/2023/05/building-evil-android-phone-bot-army.html
118 * Bug fixes and man page updates.
120 News about GNU Parallel:
122 * Introduction to parallel computing https://youtu.be/fvrHXV8yqU4?t=2874
124 * Script for summarizing GNU parallel joblog file https://github.com/gavinmdouglas/parallel_joblog_summary
126 * How to copy a single file to multiple directories in Linux or Unix https://www.cyberciti.biz/faq/linux-unix-copy-a-file-to-multiple-directories-using-cp-command/
128 * Search in your Jupyter notebooks from the CLI, fast. https://dev.to/attilavm/search-in-your-jupyter-notebooks-from-the-cli-fast-1408
130 * Parallel Job Orchestration with GNU Parallel https://www.youtube.com/watch?v=2tVpUfND3LI
132 * Optional Individual Submission 4 Job Handling 20266001 - GNU Parallel https://www.youtube.com/watch?v=eC_RPuFCcU8
134 * DOE Cross-facility Workflows Training - April 12, 2023 https://www.youtube.com/watch?v=Ke3sirM-aQQ
136 * How to run MiXCR 4.x on multiple patient samples using GNU Parallel https://www.youtube.com/watch?v=OXg-WHlB_dk
143 * --jobs evaluates expression: +3*log(55)% = ncpu*1.12
145 * Bug fixes and man page updates.
147 News about GNU Parallel:
149 * Running shell script in parallel
150 https://w3toppers.com/running-shell-script-in-parallel/
152 * Simulating climate risk scenarios for the Amazon Rainforest
153 https://aws.amazon.com/blogs/hpc/simulating-climate-risk-scenarios-for-the-amazon-rainforest/
155 * How To Use Your Entire CPU In Bash With Parallel
156 https://bash-prompt.net/guides/parallell-bash/
158 * Bash - parallel command execution
159 https://medium.com/linuxstories/bash-parallel-command-execution-d4bd7c7cc1d6
161 * 3 tips for faster batch post-pro
162 https://www.cfdengine.com/newsletter/142/
169 * Better support for wide characters in --latest-line.
171 * Support for rsync 3.2.7.
173 * Bug fixes and man page updates.
180 * parsort: --parallel now does closer to what you expect.
182 * parallel: --files0 is --files but \0 separated.
184 * Bug fixes and man page updates.
186 News about GNU Parallel:
188 * 5 great Perl scripts to keep in your sysadmin toolbox
189 https://www.redhat.com/sysadmin/perl-scripts
196 * Bug fixes and man page updates.
198 News about GNU Parallel:
200 * The Best Ethical Hacking Tools of 2023 (and their basic usage)
201 https://www.purevpn.com/blog/the-best-hacking-tools-of-2023/#11_GNU_Parallel
203 * GNU Parallel: criando atividades em paralelo com shell script
204 https://www.vivaolinux.com.br/artigo/GNU-Parallel-criando-atividades-em-paralelo-com-shell-script/
211 * --results works on more file systems (e.g. fat)
213 * Joblog gives the same exit code as bash.
215 News about GNU Parallel:
217 * Programação Shell Linux: Paralelismo de processos com GNU parallel
218 https://www.youtube.com/watch?v=duheTWLIrp8
220 * Talk Python: Data Science from the Command Line
221 https://talkpython.fm/episodes/show/392/data-science-from-the-command-line
228 * Support for IPv6 adresses and _ in hostnames in --sshlogin.
230 * Use --total-jobs for --eta/--bar if generating jobs is slow.
232 * A lot of bugs fixed in --latest-line.
234 * Better support for MSYS2.
236 * Better Text::CSV error messages.
238 * --bar supports UTF8.
240 * Bug fixes and man page updates.
242 News about GNU Parallel:
244 * GNU Parallel is now on Mastodon: @GNU_Parallel@hostux.social
251 * --latest-line chops line length at terminal width.
253 * Determine max command length faster on Microsoft Windows.
255 News about GNU Parallel:
257 * Distributed Task Processing with GNU Parallel
258 https://www.youtube.com/watch?v=usbMLggdMgc
260 * GNU Parallel workflow for many small, independent runs
261 https://docs.csc.fi/support/tutorials/many/
263 * Copy a File To Multiple Directories With A Single Command on Linux
264 https://www.linuxfordevices.com/tutorials/linux/copy-file-to-multiple-directories-with-one-command
266 * Behind The Scenes: The Power Of Simple Command Line Tools At Cloud
268 https://blog.gdeltproject.org/behind-the-scenes-the-power-of-simple-command-line-tools-at-cloud-scale/
270 * Run lz4 compression in parallel using GNU parallel
271 https://www.openguru.com/2022/09/
273 * Xargs / Parallel With Code Examples
274 https://www.folkstalk.com/2022/09/xargs-parallel-with-code-examples.html
276 * Parallel processing on a single node with GNU Parallel
277 https://www3.cs.stonybrook.edu/~cse416/Section01/Slides/SeaWulfIntro_CSE416_09222022.pdf
279 * Using GNU parallel painlessly -- from basics to bioinformatics job
280 orchestration https://www.youtube.com/watch?v=qypUdm-IE9c
287 * --colour-failed only changes output for failing jobs.
289 * Password for --sshlogin can be put in $SSHPASS.
291 * Examples are moved from `man parallel` to `man parallel_examples`.
293 * Bug fixes and man page updates.
295 News about GNU Parallel:
297 * WOMM - Works On My Machine uses GNU Parallel https://pypi.org/project/womm/
304 * --header 0 allows using {filename} as replacement string
306 * Bug fixes and man page updates.
313 * --colour-failed will color output red if the job fails.
315 * sql: support for InfluxDB.
317 * Polarhome.com is dead, so these OSs are no longer supported: AIX
318 HPUX IRIX Minix OPENSTEP OpenIndiana OpenServer QNX Solaris Syllable
319 Tru64 Ultrix UnixWare.
321 * Bug fixes and man page updates.
328 * , can be used in --sshlogin if quoted as \, or ,,
330 * --plus {/#regexp/str} replace ^regexp with str.
332 * --plus {/%regexp/str} replace regexp$ with str.
334 * --plus {//regexp/str} replace every regexp with str.
336 * 'make install' installs bash+zsh completion files.
338 * Bug fixes and man page updates.
345 * --latest-line shows only the latest line of running jobs.
347 * --color colors output in different colors per job (this obsoletes --ctag).
349 * xargs compatibility: --process-slot-var foo sets $foo to jobslot-1.
351 * xargs compatibility: --open-tty opens the terminal on stdin (standard input).
353 * Bug fixes and man page updates.
355 News about GNU Parallel:
357 * Building a fault-tolerant work queue for command-line executions
358 with GNU Parallel https://www.jvt.me/posts/2022/04/28/shell-queue/
360 * Make your code do more, with less
361 https://www.blopig.com/blog/2022/05/make-your-code-do-more-with-less/
363 * W09 B IntroHPC II 20220513 gnu parallel
364 https://www.youtube.com/watch?v=2udvC90rIa4
371 * sash is no longer supported as shell.
373 * --retries 0 is an alias for --retries 2147483647.
375 * --shell-completion returns shell completion code.
377 * --ssh-login-file reloads every second.
379 * --parset is replaced with --_parset because it is only used internally.
381 * sem --pipe passes STDIN (standard input) to the command.
383 * Bug fixes and man page updates.
390 * --sshlogin user:password@host is now supported by using sshpass.
392 * Bug fixes and man page updates.
394 News about GNU Parallel:
396 * Bash: GNU Parallel with Curl
397 https://gist.github.com/CMCDragonkai/5914e02df62137e47f32?permalink_comment_id=2617456
399 * The Pipe Operator Explained
400 https://medium.com/geekculture/the-pipe-operator-explained-cbd41e23775a
407 * Encoding of remote commands has changed. This limits the length of
408 remote commands to less than half. It also requires $REMOTE_TMPDIR
409 to be writable. It makes this release beta quality.
411 * Time functions hh_mm_ss() hhmmss() hh_mm() hhmm() are now available
414 * Many options in the man page for parallel now has 'see also' for
417 * parallel_options_map.pdf is a map showing which options other
420 * {uniq} added to --plus to only run jobs with unique values.
422 * sem --fg exits with the exit code of the job.
424 * Bug fixes and man page updates.
431 * GNU Parallel turned 20 on the 2022-01-06
432 https://www.gnu.org/software/parallel/20th-birthday.html
434 * Bug fixes and man page updates.
436 News about GNU Parallel:
438 * Save Time with Modern Search Techniques
439 https://www.eventbrite.com/e/ohio-information-security-forum-january-2022-monthly-meeting-tickets-240632737997
441 * Bash "Fail immediately if any fails"
442 https://morioh.com/p/a01b883dc57c
444 * Re-encoding the EmacsConf videos with FFmpeg and GNU Parallel
445 https://sachachua.com/blog/2021/12/re-encoding-the-emacsconf-videos-with-ffmpeg-and-gnu-parallel/
447 * Bash 平行 https://learntutorials.net/ja/bash/topic/10778/%E5%B9%B3%E8%A1%8C
454 * Bug fixes and man page updates.
456 News about GNU Parallel:
458 * The first version of Parallel will be 20 years on 2022-01-06
460 * HerrComp Intro HPC gnu parallel
461 https://www.youtube.com/watch?v=tcgjKWfgWQY
464 https://qiita.com/toramili/items/44a770cfb9ef1edc9e26
466 * How To Install parallel on Ubuntu 20.04
467 https://installati.one/ubuntu/20.04/parallel/
469 * Distributing embarrassingly parallel tasks GNU Parallel
470 https://ulhpc-tutorials.readthedocs.io/en/latest/sequential/gnu-parallel/
477 * Bug fixes and man page updates.
479 News about GNU Parallel:
481 * Otimizando o seu Hacking com o GNU Parallel - Mateus Buogo
482 https://www.youtube.com/watch?v=xIpPPZXDKGU
484 * SMACK 12 - Do it faster! Simple ways to use all those cores (and
485 GPUs) efficiently. https://www.youtube.com/watch?v=lXDGY7NvOYk
492 * Don't postpone output until $jobslots jobs have been started.
494 * Bug fixes and man page updates.
496 News about GNU Parallel:
498 * How to Install GNU Parallel using Anaconda | Linux
499 https://www.youtube.com/watch?v=UwDNVP-L0qA
501 * Install GNU Parallel from source code | Linux
502 https://www.youtube.com/watch?v=PIyJH4ben5o
504 * Compiling GNU Parallel on CentOS-7
505 https://thelinuxcluster.com/2021/10/19/compiling-gnu-parallel-on-centos-7/
512 * Bug fixes and man page updates.
514 News about GNU Parallel:
516 * 3 Programs that will Level Up your Bash Game
517 https://medium.com/codex/3-programs-that-will-level-up-your-bash-game-bf14e17e2291
519 * I Summarized 100+ Command-Line Tools for Data Scientists in 15
521 https://towardsdatascience.com/i-summarized-100-command-line-tools-for-data-scientists-in-15-minutes-976def544ffe
523 * Speed up Your Builds by Parallelizing
524 https://www.incredibuild.com/blog/speed-up-your-builds-by-parallelizing
526 * Bash: GNU Parallel with Curl
527 https://gist.github.com/dinh/93b936a55de9a331199d6582bc2921d2
534 * --ctag/--ctagstring colors the tag in different colors for each job.
536 * You can use unit prefixes (k, m, g, etc) with -n -N -L.
538 * Bug fixes and man page updates.
540 News about GNU Parallel:
542 * Parallelising jobs with GNU parallel
543 https://blog.ronin.cloud/gnu-parallel/
545 * Use multiple CPU Cores with your Linux commands - awk, sed, bzip2,
546 grep, wc, etc. https://cdmana.com/2021/07/20210728132344693t.html
548 * How to execute commands in parallel in Linux
549 https://net2.com/how-to-execute-commands-in-parallel-in-linux/
556 * --results no longer prints the result to standard output (stdout) as
558 https://lists.gnu.org/archive/html/parallel/2020-12/msg00003.html
560 * parset supports associative arrays in bash, ksh, zsh.
562 * Online HTML is now generated by Sphinx.
564 * Bug fixes and man page updates.
566 News about GNU Parallel:
568 * Cleaning Up Scanned Documents with Open Source Tools
569 https://kaerumy.medium.com/cleaning-up-scanned-documents-with-open-source-tools-9d87e15305b
576 * Bug fixes and man page updates.
578 News about GNU Parallel:
580 * How to use GNU Parallel
581 https://techtipbits.com/linux/how-to-use-gnu-parallel/
583 * How to Speed Up Bash Scripts with Multithreading and GNU Parallel
584 https://adamtheautomator.com/how-to-speed-up-bash-scripts-with-multithreading-and-gnu-parallel/
586 * Use Parallel to split by line
587 https://madflex.de/use-parallel-to-split-by-line/
589 * Optimizing long batch processes or ETL by using buff/cache properly
590 II (parallelizing network operations)
591 http://www.elsotanillo.net/2021/06/optimizing-long-batch-processes-or-etl-by-using-buff-cache-properly-ii-parallelizing-network-operations/
593 * Parallelization 3: GNU Parallel https://www.youtube.com/watch?v=Rl06WD60afA
600 * --plus includes {%%regexp} and {##regexp}.
602 * Bug fixes and man page updates.
604 News about GNU Parallel:
606 * Batch Calculate and Verify MD5 Checksum With GNU Parallel
607 https://omicx.cc/posts/2021-04-28-calculate-and-verify-md5-checksum-with-gnu-parallel/
609 * HerrComp Gnu parallel, c++11 threads 2021 04 28
610 https://www.youtube.com/watch?v=wDd9F9nn0qA
612 * Distributing embarrassingly parallel tasks GNU Parallel
613 https://ulhpc-tutorials.readthedocs.io/en/latest/sequential/gnu-parallel/
615 * Job Parallelization on Niagara
616 https://www.maryamdaryalal.com/post/job-parallelization-on-niagara
618 * Use Parallel to split by line
619 https://madflex.de/use-parallel-to-split-by-line/
621 * m1 multi-core batch convert with gpu parallel + ffmpeg
622 https://www.youtube.com/watch?v=hAuc0YsXv6A
629 * Bug fixes and man page updates.
631 News about GNU Parallel:
633 * Bioinformatics tutorials - linux and shell advanced - parallel
634 https://www.youtube.com/watch?v=5leL8pyl0XA
636 * GNU Parallel for quick gains
637 https://edbennett.github.io/high-performance-python/04-gnu-parallel/index.html
639 * Processing Linux Commands in Parallel
640 https://www.baeldung.com/linux/processing-commands-in-parallel
643 https://docs-research-it.berkeley.edu/services/high-performance-computing/user-guide/running-your-jobs/gnu-parallel/
645 * GNU Parallel 활용 가이드https://genoglobe.com/kribb/gnu_parallel
647 * Parallel Grep and Awk
648 https://www.highonscience.com/blog/2021/03/21/parallel-grep/
650 * Getting things done with shell scripting
651 https://doma.dev/blog/get-things-done-with-bash/
656 * Bug fixes and man page updates.
658 News about GNU Parallel:
660 * The very first version of Parallel dated 2002-01-06 was found in an
671 (".PHONY : job$jobnr\n",
675 unshift @makefile, "all : ",(map { "job$_ " } 1 .. $jobnr),"\n";
677 open (MAKE, "| make -k -f - -j $processes") || die;
678 print MAKE @makefile;
681 * Introduction to GNU Parallel
682 https://www.youtube.com/watch?v=Kj-6JkAqw-8
684 * Using GNU Parallel with GooseSLURM
685 https://readthedocs.org/projects/gooseslurm/downloads/pdf/latest/#chapter.7
688 https://github.com/lijingbu/omics/blob/main/why_gnu_parallel.md
693 * --filter only run jobs where the filter is true. The filter can
694 contain replacement strings and Perl code such as: '{1} < {2}+1'
696 * --template takes a text file as a template with replacement
697 strings. Then it replaces the replacement strings and saves it
698 under a new filename.
700 * --plus implements {0%} {0#} replacement string for zero padded slot
703 * Warn that you probably mean -d '\r\n' if the first 3 values end in
706 * {= perlexpression =} must return the same value, if run twice on the
709 * Man pages available as .rst-format.
711 * Bug fixes and man page updates.
713 News about GNU Parallel:
715 * A short tutorial on Gnu Parallel
716 https://www.polarmicrobes.org/a-short-tutorial-on-gnu-parallel/
718 * 5 reasons why I love coding on Linux
719 https://opensource.com/article/21/2/linux-programming
721 * Simple Tutorial to install & use GNU Parallel
722 https://medium.com/analytics-vidhya/simple-tutorial-to-install-use-gnu-parallel-79251120d618
724 * LiDO3 - first contact
725 https://www.lido.tu-dortmund.de/cms/de/LiDO3/LiDO3_first_contact_handout.pdf
727 * Rill Stage 2-1: Ways of command-line data analysis
728 https://blog.jastix.biz/post/rill-stage-2-1-cli-data-analysis/
730 * Introduction to GNU Parallel
731 https://blog.knoldus.com/introduction-to-gnu-parallel/
733 * GNU Parallel https://www.hahwul.com/cullinan/parallel/
738 * --memsuspend suspends jobs when there is little memory free. This
739 way you can run jobs in parallel that added up potentially will take
740 up more RAM than is available.
742 * $PARALLEL_ARGHOSTGROUPS and the replacement string {agrp} will give
743 the hostgroup given on the argument when using --hostgroup.
745 * Handy time functions for {= =}: yyyy_mm_dd_hh_mm_ss()
746 yyyy_mm_dd_hh_mm() yyyy_mm_dd() yyyymmddhhmmss() yyyymmddhhmm()
747 yyyymmdd() hash($str)
749 * Bug fixes and man page updates.
751 News about GNU Parallel:
753 * Software Engineering For Scientists
754 https://canvas.stanford.edu/courses/133091
756 * Optional Individual Submission 4 Job Handling - GNU Parallel
757 https://www.youtube.com/watch?v=-tX0bFAYAxM
759 * 关于gnu parallel:GnuParallel:在集群上并行化脚本,脚本将文件写入主
760 节点https://www.codenong.com/25172209/
763 https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
768 * --pipe engine changed making --pipe alpha quality.
770 * --results -.json outputs results as JSON objects on stdout (standard
773 * --delay 123auto will auto-adjust --delay. If jobs fail due to being
774 spawned too quickly, --delay will exponentially increase.
776 * --plus sets {hgrp} that gives the intersection of the hostgroups of
777 the job and the sshlogin that the job is run on.
779 * Bug fixes and man page updates.
781 News about GNU Parallel:
783 * Best practices for accelerating data migrations using AWS Snowball
785 https://aws.amazon.com/blogs/storage/best-practices-for-accelerating-data-migrations-using-aws-snowball-edge/
787 * Pass the Output of a Command as an Argument for Another
788 https://www.baeldung.com/linux/pass-cmd-output-as-an-argument
790 * Warwick RSE Drop-in - Workflow Management Part 2 - GNU Parallel
791 https://www.youtube.com/watch?v=t_v2Otgt87g
796 * Bug fixes and man page updates.
798 News about GNU Parallel:
800 * https://bash-prompt.net/guides/gnu-parallel-multi-server/
805 * --termseq now works for jobs running remotely.
807 * parsort: Performance optimized for 64-core machines.
809 * Bug fixes and man page updates.
811 News about GNU Parallel:
813 * Juan Sierra Pons has made a testimonial:
814 http://www.elsotanillo.net/wp-content/uploads/GnuParallel_JuanSierraPons.mp4
816 * 「翻译」在生物信息学中使用 GNU-Parallel
817 https://cloud.tencent.com/developer/article/1705499
822 * New CPU detection for GNU/Linux.
824 * Bug fixes and man page updates.
826 News about GNU Parallel:
828 * Aug 21, 2020 - More Unix tools
829 https://floki.blog/2020/08/more_unix_tools
836 * Max command line length is changed for MacOS - making this version
837 beta quality for MacOS.
839 * Bug fixes and man page updates.
846 * No new functionality
848 * Bug fixes and man page updates.
850 News about GNU Parallel:
852 * Tips for Running Jobs on your VM
853 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
855 * Introduction to GNU Parallel: Parallelizing Massive Individual Tasks
856 https://www.youtube.com/watch?v=QSFLTEyCKvo
859 http://www.hpc.lsu.edu/training/weekly-materials/2020-Spring/GNUParallel_Spring_2020.pdf
861 * Linux-Fu: Parallel Universe
862 https://hackaday.com/2020/06/29/linux-fu-parallel-universe/
864 * Resumable batch jobs with gnu parallel https://igor.io/parallel/
866 * Introducing Parallel into Shell
867 https://www.petelawson.com/post/parallel-in-shell/
869 * AV1 encoding parallelization with GNU Parallel
870 https://www.reddit.com/r/AV1/comments/fjvqp9/av1_encoding_parallelization_with_gnu_parallel/
872 * Beschleunigte Befehlsbearbeitung mit GNU Parallel
873 https://www.linux-community.de/ausgaben/linuxuser/2013/06/beschleunigte-befehlsbearbeitung-mit-gnu-parallel/
880 * No new functionality
882 * Bug fixes and man page updates.
884 News about GNU Parallel:
886 * GNU Parallel is used at NERSC:
887 https://www.nersc.gov/assets/Uploads/08-Workflows-20200616.pdf
889 * Resumable batch jobs with GNU Parallel https://igor.io/parallel/
891 * Lab Meeting technical talk
892 https://www.slideshare.net/hoffmanlab/gnu-parallel-194030490
894 * Open Sky Software Website Credits
895 https://www.openskysoftware.com/site-credits.htm
897 * Speed up your Python Scripts using Ubuntu and GNU Parallel
898 https://ecce.esri.ca/wpecce/2019/12/24/speed-up-your-python-scripts-using-ubuntu-and-gnu-parallel/
900 * Indispensable command-line tools
901 https://negfeedback.blogspot.com/2020/05/indispensable-command-line-tools.html
903 * GNU Parallel for simulations
904 http://pdebuyl.be/blog/2020/gnu-parallel-for-simulations.html
906 * Introduction to GNU parallel
907 https://bioinformaticsworkbook.org/Appendix/GNUparallel/GNU_parallel_examples.html
914 * While running a job $PARALLEL_JOBSLOT is the jobslot of the job. It
915 is equal to {%} unless the job is being retried. See {%} for
918 * While running a job $PARALLEL_SSHLOGIN is the sshlogin line with
919 number of cores removed. E.g. '4//usr/bin/specialssh user@host'
920 becomes: '/usr/bin/specialssh user@host'
922 * While running a job $PARALLEL_SSHHOST is the host part of an
923 sshlogin line. E.g. '4//usr/bin/specialssh user@host' becomes:
926 * --plus activates the replacement strings {slot} = $PARALLEL_JOBSLOT,
927 {sshlogin} = $PARALLEL_SSHLOGIN, {host} = $PARALLEL_SSHHOST
929 * Bug fixes and man page updates.
931 News about GNU Parallel:
933 * Portable Batch System (PBS) & GNU Parallel - Running a Program
934 Multiple Times in Parallel
935 https://www.youtube.com/watch?v=6ccbWu6Befo
937 * GNU Parallel przykład https://www.youtube.com/watch?v=gs_wG4Kt2G4
939 * Demo of LINUX APP - GNU PARALLEL - running multiple Gstreamer webcam
940 .sh scripts with only 1 command
941 https://www.youtube.com/watch?v=trQuA_wmWjg
946 This release celebrates GNU Parallel's 10 years as a GNU tool:
948 > commit ed2dfb1043768154d4e7678e01e10287155fa834
949 > Author: Ole Tange <ole@tange.dk>
950 > Date: Thu Apr 22 01:23:00 2010 +0200
952 > Name change: Parallel is now GNU Parallel.
953 > Basic structure for sshlogin and sshloginfile.
957 * parsort makes GNU sort run faster for files with more than 1M lines.
959 * Bug fixes and man page updates.
961 News about GNU Parallel:
963 * Several clusters have updated their documentation of GNU Parallel:
964 https://www.grid5000.fr/w/GNU_Parallel
965 https://research-it.berkeley.edu/virtual-training-running-jobs-parallel-savio
966 http://www.hpc.lsu.edu/training/archive/tutorials.php
968 * add_pho uses GNU Parallel: https://github.com/SeedlingsBabylab/add_pho
970 * GNU parallel使用笔记https://zhuanlan.zhihu.com/p/37340011
972 * Virtual Workshop: Running Jobs in Parallel on Savio
973 https://ais.berkeley.edu/events/virtual-workshop-running-jobs-parallel-savio/2020-04-20
975 * Free Concurrency with GNU Parallel
976 https://phili.pe/posts/free-concurrency-with-gnu-parallel/
981 * Bug fixes and man page updates.
983 News about GNU Parallel:
985 * The GNU Parallel course in Copenhagen is cancelled
986 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
988 * The GNU Parallel course in Århus is cancelled
989 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
991 * The 10 year anniversary may be cancelled, see
992 https://www.gnu.org/software/parallel/10-years-anniversary.html
994 * Running shell commands in parallel, via GNU Parallel
995 https://dev.to/saveriomiroddi/running-shell-commands-in-parallel-via-gnu-parallel-3a72
997 * Faster nmap scanning with the help of GNU parallel
998 https://badshah.io/experiment/faster-nmap-scanning-with-the-help-of-gnu-parallel/
1003 * Bug fixes and man page updates.
1008 * --blocktimeout dur - Time out for reading block when using
1009 --pipe. If it takes longer than dur to read a full block, use the
1010 partial block read so far.
1012 * Bug fixes and man page updates.
1014 News about GNU Parallel:
1016 * GNU Parallel course in Copenhagen
1017 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
1019 * GNU Parallel course in Århus
1020 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
1022 * GNU Parallel pour accélérer vos process sous Linux
1023 https://www.yvonh.com/gnu-parallel-pour-accelerer-vos-process-sous-linux/
1025 * How to copy a file to multiple directories in Linux
1026 https://net2.com/how-to-copy-a-file-to-multiple-directories-in-linux/
1028 * Running linux commands in parallel https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8
1033 * GNU Parallel course in Copenhagen
1034 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
1036 * GNU Parallel course in Århus
1037 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
1039 * GNU Parallel is used in
1040 https://github.com/JeffersonLab/rfw_tsf_extractor
1042 * Bug fixes and man page updates.
1047 * GNU Parallel was presented at Driving IT. Slides:
1048 cloud.prosa.dk/s/drivingit
1050 * Restarting supervisord processes in parallel
1051 https://blog.naderman.de/2019/11/14/restarting-supervisord-processes-in-parallel/
1053 * Using GNU Parallel to Create Archives Faster
1054 https://www.reddit.com/r/DataHoarder/comments/dsgmhc/parallel_archiving_techniques/
1056 * Bug fixes and man page updates.
1061 * --tee will use --output-error=warn-nopipe if supported by tee.
1063 * GNU Parallel will be presented at Driving IT 2019:
1064 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools
1066 * UMN Duluth: Job parallelization with task arrays and GNU parallel
1067 https://www.msi.umn.edu/tutorials/umn-duluth-job-parallelization-task-arrays-and-gnu-parallel
1069 * Genome updater uses GNU Parallel
1070 https://github.com/pirovc/genome_updater
1072 * Using GNU-Parallel for bioinformatics
1073 https://www.danielecook.com/using-gnu-parallel-for-bioinformatics/
1075 * Speeding up PostgreSQL ETL pipeline with the help of GODS
1076 https://cfengine.com/company/blog-detail/speeding-up-postgresql-etl-pipeline-with-the-help-of-gods/
1078 * Runing linux commands in parallel
1079 https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8
1081 * Research Computing University of Colorado Boulder contains an intro
1083 https://readthedocs.org/projects/curc/downloads/pdf/latest/
1085 * 如何使用Parallel在Shell中并行执行命令
1086 https://www.myfreax.com/gnu-parallel/
1088 * 如何测试 Amazon Elastic File System
1089 https://aws.amazon.com/cn/blogs/china/how-to-test-drive-amazon-elastic-file-system/
1091 * Bug fixes and man page updates.
1096 * --nice is now inherited by the nice level that GNU Parallel is
1097 started at. So 'nice -n10 parallel' will also cause remote jobs to
1098 be run at nice level 10.
1100 * --delay is now accurate to within 10 ms
1102 * GNU Parallel will be presented at Driving IT 2019:
1103 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools
1105 * Greenland Ice Sheet solid ice discharge from 1986 through 2017
1106 https://www.earth-syst-sci-data.net/11/769/2019/essd-11-769-2019.pdf
1108 * App Center Cloud Build Machines > Installed Software > Utilities
1109 https://docs.microsoft.com/en-us/appcenter/build/software
1111 * Curryfinger - SNI & Host header spoofing utility
1112 https://dualuse.io/blog/curryfinger/
1115 https://wiki.cac.washington.edu/display/hyakusers/Hyak+parallel-sql
1117 * A meditation on analysing data with Perl in parallel using GNU Parallel
1118 https://www.reddit.com/r/perl/comments/cyo2qc/a_meditation_on_analysing_data_with_perl_in/
1120 * Accélérer ses tâches avec GNU Parallel et les lots de tâches (UL)
1121 https://www.eventbrite.ca/e/inscription-accelerer-ses-taches-avec-gnu-parallel-et-les-lots-de-taches-ul-71412840729
1123 * RMACC Summit GNU Parallel
1124 https://curc.readthedocs.io/en/latest/software/GNUParallel.html
1126 * Introducing Parallel into Shell
1127 https://petelawson.com/post/parallel-in-shell/
1129 * Linux Productivity Tools
1130 https://www.usenix.org/conference/lisa19/presentation/maheshwari
1132 * Gnu/parallel + Nfs 实现共享文件网络的并发计算等操作
1133 http://atomicer.cn/2018/01/18/gnu-parallel-nfs-%E5%AE%9E%E7%8E%B0%E5%85%B1%E4%BA%AB%E6%96%87%E4%BB%B6%E7%BD%91%E7%BB%9C%E7%9A%84%E5%B9%B6%E5%8F%91%E8%AE%A1%E7%AE%97%E7%AD%89%E6%93%8D%E4%BD%9C/#more
1135 * Bug fixes and man page updates.
1140 * GNU Parallel will be presented at Driving IT 2019:
1141 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it#beskrivelse
1143 * Linux Productivity Tools
1144 https://www.usenix.org/conference/lisa19/presentation/maheshwari
1146 * Improve your reconnaissance performance by using GNU Parallel
1147 https://mailchi.mp/3f46ceb46357/improve-your-reconnaissance-performance-by-using-gnu-parallel
1149 * Paralel İşler / İşlemler / Programlar Bash’de Nasıl Çalıştırılır?
1150 https://kaleinfo.com/2019/07/29/paralel-isler-islemler-programlar-bashde-nasil-calistirilir-2/
1152 * Use POLYBAR to change WALLPAPER with GNU Parallel
1153 https://www.youtube.com/watch?v=rjYg-b_eiRU
1155 * Finding the Balance Between Speed & Accuracy During an Internet-wide
1157 https://captmeelo.com/pentest/2019/07/29/port-scanning.html
1159 * GNU Parallel Ryugu released
1160 https://linuxreviews.org/GNU_Parallel_Ryugu_released
1162 * CO2017 - CW1 - Operating Systems & Networks - Shell scripting
1163 http://www.7daixie.com/2019071646302396.html
1165 * Bug fixes and man page updates.
1170 * {= uq; =} causes the replacement string to be unquoted. Example:
1171 parallel echo '{=uq;=}.jpg' ::: '*'
1173 * --tagstring {=...=} is now evaluated for each line with --linebuffer.
1175 * Use -J ./profile to read a profile in current dir.
1177 * Speedup of startup by 40%: Find the parent shell differently on
1178 GNU/Linux, cache information about the CPU and which setpgrp method
1179 to use to make GNU Parallel start 40% faster.
1181 * $PARALLEL_SSHLOGIN can be used in the command line.
1183 * Occasionally sane: Simple usage of GNU parallel
1184 https://vfoley.xyz/parallel/
1186 * How to run multiple bash scripts in parallel
1187 https://techieroop.com/how-to-run-multiple-bash-scripts-in-parallel/
1189 * Announcing Oracle Solaris 11.4 SRU10
1190 https://blogs.oracle.com/solaris/announcing-oracle-solaris-114-sru10
1192 * Руководство по использованию GNU Parallel https://zalinux.ru/?p=2623
1194 * Bug fixes and man page updates.
1199 * --shard can now take a column name and optionally a perl
1200 expression. Similar to --group-by and replacement strings.
1202 * Using AWK and R to parse 25tb
1203 https://livefreeordichotomize.com/2019/06/04/using_awk_and_r_to_parse_25tb/
1205 * Parallel and Visual testing with Behat
1206 http://parallelandvisualtestingwithbehat.blogspot.com/p/blog-page.html
1208 * 维基百科,自由的百科全书https://zh.wikipedia.org/wiki/GNU_parallel
1210 * Bug fixes and man page updates.
1215 * --group-by groups lines depending on value of a column. The value
1218 * How to compress (bzip / gzip) a very large text quickly?
1219 https://medium.com/@gchandra/how-to-compress-bzip-gzip-a-very-large-text-quickly-27c11f4c6681
1221 * Simple tutorial to install & use GNU Parallel
1222 https://medium.com/@gchandra/simple-tutorial-to-install-use-gnu-parallel-79251120d618
1224 * Introducing Parallel into Shell
1225 https://petelawson.com/post/parallel-in-shell/
1227 * Bug fixes and man page updates.
1232 * Invitation to the 10 years anniversary next year.
1234 * Bug fixes and man page updates.
1239 * SIGTERM is changed to SIGHUP, so sending SIGHUP will make GNU
1240 Parallel start no more jobs, but wait for running jobs to finish.
1242 * SIGTERM SIGTERM is changed to SIGTERM, so sending SIGTERM will make
1243 GNU Parallel kill all running jobs.
1245 * GNU Parallel now includes a cheat sheet: parallel_cheat.pdf
1247 * High Throughput Computing on RMACC Summit and Beyond
1248 https://calendar.colorado.edu/event/high_throughput_computing_on_rmacc_summit_and_beyond#.XH2NBhB7mV4
1250 * GNU Parallel Cheat Sheet by cpriest
1251 https://www.cheatography.com/cpriest/cheat-sheets/gnu-parallel/
1253 * Use Multiple CPU Cores(Parallelize) with Single Threaded Linux
1255 http://xensoft.com/use-multiple-cpu-cores-parallelize-with-single-threaded-linux-commands/
1257 * Bug fixes and man page updates.
1262 * --shard makes it possible to send input to a the same jobslot based
1263 on the value in one column of the input. It is similar to sharding
1266 * --shellquote --shellquote will shell quote the input twice.
1268 * GNU Parallel is available in Termux
1269 https://github.com/termux/termux-packages/tree/master/packages/parallel
1271 * Linux, command line & MetaCentrum
1272 https://trapa.cz/sites/default/files/linux_bash_metacentrum_course_4.pdf
1274 * How to supercharge your bash workflows with GNU parallel
1275 https://medium.freecodecamp.org/how-to-supercharge-your-bash-workflows-with-gnu-parallel-53aab0aea141
1277 * GNU Parallel Spring 2017 https://www.youtube.com/watch?v=LHb29uW_KyI
1279 * Parallelizing Freesurfer blog.cogneurostats.com/?p=148
1281 * FreeSurfer #4: Running recon-all in Parallel https://www.youtube.com/watch?v=XHN2tm3tNaw
1283 * FreeSurfer: recon-all https://www.neurotrivial.com/2019/01/24/freesurfer-recon-all/
1285 * Come ridimensionare 10k foto con la riga di comando
1286 https://pigrecoinfinito.wordpress.com/2018/12/22/come-ridimensionare-10k-foto-con-la-riga-di-comando/
1288 * 并行处理 – Gnu Parallel:嵌套并行
1289 https://codeday.me/bug/20190122/552902.html
1291 * シェルスクリプトでコマンドを並列実行する方法
1292 https://www.kwbtblog.com/entry/2019/01/12/020423
1294 * Bug fixes and man page updates.
1299 * 'env_parallel --end-session' makes it possible to nest 'env_parallel
1302 * Using GNU Parallel in pentesting https://youtu.be/mZ0OUJmkIlA?t=873
1304 * Supercomputer Workshop: Feb 1&7
1305 http://www.ece.unm.edu/featured-students/supercomputer-workshop-feb-17.html
1307 * Bug fixes and man page updates.
1312 * Better /proc/cpuinfo parser.
1314 * Simpler job scheduling flow.
1316 * MPGI Workshop: Job Parallelization with Task Arrays and GNU Parallel
1317 https://www.msi.umn.edu/tutorials/mpgi-workshop-module-4
1319 * CONCOCT uses GNU Parallel
1320 https://media.readthedocs.org/pdf/concoct/latest/concoct.pdf
1322 * If you use SLURM read
1323 https://wiki.hpc.uconn.edu/index.php/Advanced_SLURM
1326 https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
1328 * Bug fixes and man page updates.
1333 * Experimental simpler job flow control.
1335 * 時間がかかるコマンドを GNU parallel で 並列実行する
1336 https://qiita.com//grohiro/items/4db3fa951a4778c5c479
1338 * Bug fixes and man page updates.
1343 * env_parallel.fish: --session support (alpha quality)
1345 * GNU Parallel was cited in: High-throughput sequencing of murine
1346 immunoglobulin heavy chain repertoires using single side unique
1347 molecular identifiers on an Ion Torrent PGM
1348 https://doi.org/10.18632/oncotarget.25493
1350 * GNU parallel in Japanese Wikipedia
1351 https://ja.wikipedia.org/wiki/GNU_parallel
1353 * Outils de paramétrisation des tâches: lots de tâches, GNU Parallel
1354 https://www.eventbrite.ca/e/inscription-outils-de-parametrisation-des-taches-lots-de-taches-gnu-parallel-et-bqtools-midi-conference-de-50271076142
1356 * Bug fixes and man page updates.
1361 * Minix is supported again.
1363 * Updated graph showing GNU Parallel's overhead per job for each
1364 version. https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
1366 * Intro to Computing at CARC includes introduction to GNU Parallel
1367 http://carc.unm.edu/education--training/workshops-and-seminars.html
1369 * Fast-GBS uses GNU Parallel https://bitbucket.org/jerlar73/fast-gbs/wiki/Home
1371 * Belgium at 10 m resolution in July 2018 http://www.cesbio.ups-tlse.fr/multitemp/?p=14116
1373 * Bug fixes and man page updates.
1378 * parset sets exit code.
1380 * How to install GNU Parallel
1381 https://www.techrepublic.com/videos/how-to-install-gnu-parallel/
1383 * Bug fixes and man page updates.
1388 * The quoting engine has been changed. Instead of using \-quoting GNU
1389 Parallel now uses '-quoting in bash/ash/dash/ksh. This should
1390 improve compatibility with different locales. This is a big change
1391 causing this release to be alpha quality.
1393 * The CPU calculation has changed. By default GNU Parallel uses the
1394 number of CPU threads as the number of CPUs. This can be changed to
1395 the number of CPU cores or number of CPU sockets with
1396 --use-cores-instead-of-threads or --use-sockets-instead-of-threads.
1398 * The detected number of sockets, cores, and threads can be shown with
1399 --number-of-sockets, --number-of-cores, and --number-of-threads.
1401 * env_parallel now support mksh using env_parallel.mksh.
1403 * GNU Parallel is distributed as part of Snippy
1404 https://github.com/tseemann/snippy
1406 * GNU Parallel: Ejecutar comandos simultáneamente en Linux
1407 https://esgeeks.com/gnu-parallel-ejecutar-comandos-simultaneo-linux/
1409 * Parallel download genomic data with GNU-Parallel
1410 https://digibio.blogspot.com/search/label/GNU-Parallel
1412 * Bug fixes and man page updates.
1417 * Deal better with multibyte chars by forcing LC_ALL=C.
1419 * GNU Parallel was introduced in Pincount Podcast:
1420 https://pincountpodcast.com/episodes/29.html
1422 * GNU Parallel was shown on Danish national news for 1.7 seconds: dr.dk
1424 * How to run Linux commands simultaneously with GNU Parallel
1425 https://www.techrepublic.com/article/how-to-run-commands-simultaneously-with-gnu-parallel/#ftag=RSS56d97e7
1427 * Easy parallelization with GNU parallel
1428 http://mpharrigan.com/2016/08/02/parallel.html
1430 * GNU Parallel for mutlithreaded tasks
1431 http://slhogle.github.io/2016/gnu-parallel/
1433 * A GNU Parallel Clustering Demo
1434 https://www.crowdsupply.com/ground-electronics/circumference/updates/a-gnu-parallel-clustering-demo
1436 * 使用 GNU Parallel 提高 Linux 命令行执行效率
1437 https://linux.cn/article-9718-1.html
1439 * Ejecutando tareas desde consola simultáneamente con GNU Parallel
1440 https://poesiabinaria.net/2018/06/ejecutando-tareas-desde-consola-simultaneamente-gnu-parallel/
1442 * Cómo ejecutar varias tareas simultáneamente en el terminal con GNU
1444 https://www.ubuntizando.com/como-ejecutar-varias-tareas-simultaneamente-en-el-terminal-con-gnu-parallel/
1446 * GNU Parallel 활용 가이드 http://genoglobe.kr/kribb/gnu_parallel
1448 * Bug fixes and man page updates.
1453 * --tty allows for more programs accessing /dev/tty in parallel. Some
1454 programs require tty access without using it.
1456 * env_parallel --session will record names in current environment in
1457 $PARALLEL_IGNORED_NAMES and exit. It is only used with env_parallel,
1458 and can work like --record-env but in a single session.
1460 * 35 day course: Linux shell scripting and text processing for big
1461 data https://comquest.in/training
1463 * How To Use Your Entire CPU In Bash With Parallel
1464 https://bash-prompt.net/guides/parallell-bash/
1466 * An easy way to run parallel jobs on Stampede2
1467 https://blog.uta.edu/xus/2017/09/29/an-easy-way-to-run-parallel-jobs-on-stampede2/
1469 * Get more done at the Linux command line with GNU Parallel
1470 https://opensource.com/article/18/5/gnu-parallel
1472 * Save Time with Modern Search Techniques
1473 https://www.sans.org/summit-archives/file/summit-archive-1524582079.pdf
1475 * GNU Parallel: haz más cosas simultáneamente en el terminal
1476 https://blog.desdelinux.net/gnu-parallel-haz-mas-cosas-simultaneamente-en-el-terminal/
1478 * 「今日から使い切る」ための GNU Parallelによる並列処理入門
1479 https://www.slideshare.net/koji_matsuda/gnu-parallel
1481 * Bug fixes and man page updates.
1486 * --csv makes GNU Parallel parse the input sources as CSV. When used
1487 with --pipe it only passes full CSV-records.
1489 * Time in --bar is printed as 1d02h03m04s.
1491 * Optimization of --tee: It spawns a process less per value.
1493 * The GNU Parallel 2018 book is now available:
1494 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html
1496 * Modern pentest tricks for faster, wider, greater engagement (15)
1497 https://conference.hitb.org/hitbsecconf2018ams/materials/D1%20COMMSEC%20-%20Thomas%20Debize%20-%20Modern%20Pentest%20Tricks%20for%20Faster,%20Wider,%20Greater%20Engagements.pdf
1499 * Running many serial jobs efficiently
1500 https://userinfo.surfsara.nl/documentation/running-many-serial-jobs-efficiently
1502 * GNU Parallel: как сохранить результаты нескольких команд для
1503 переменной? http://fliplinux.com/gnu-parallel-6.html
1505 * Running Multiple Commands in Parallel on a GNU Linux
1506 https://www.youtube.com/watch?v=sHpTywpb4_4
1508 * Klaatu covers the documentation of GNU parallel in episode 12x15
1509 http://gnuworldorder.info/
1511 * Bug fixes and man page updates.
1516 * niceload -p can now take multiple pids separated by comma
1518 * --timeout gives a warning when killing processes
1520 * --embed now uses the same code for all supported shells
1522 * --delay can now take arguments like 1h12m07s
1524 * Parallel. Straight from your command line
1525 https://medium.com/@alonisser/parallel-straight-from-your-command-line-feb6db8b6cee
1527 * GNU Parallel was used in POAP-Parallelized Open Babel & Autodock
1528 suite Pipeline https://github.com/inpacdb/POAP
1530 * Pi Cluster Parallel Script First Fire
1531 https://chiefio.wordpress.com/2018/02/23/pi-cluster-parallel-script-first-fire/
1533 * How to Restore MySQL Logical Backup at Maximum Speed
1534 https://www.percona.com/blog/2018/02/22/restore-mysql-logical-backup-maximum-speed/
1536 * Bug fixes and man page updates.
1541 * --embed makes it possible to embed GNU parallel in a shell
1542 script. This is useful if you need to distribute your script to
1543 someone who does not want to install GNU parallel.
1545 * Parallelize Your Large Batches of Small Jobs
1546 https://amito.me/2018/02/Parallelize-Your-Large-Batches-of-Small-Jobs/
1548 * Klaatu expounds upon xargs and talks GNU parallel in episode 12x6
1549 http://gnuworldorder.info/
1551 * How to use parallel to speed up your work
1552 https://mike42.me/blog/how-to-use-parallel-to-speed-up-your-work
1554 * Transient compute clustering with GNU Parallel and sshfs
1555 https://dennismungai.wordpress.com/2018/02/06/transient-compute-clustering-with-gnu-parallel-and-sshfs/
1557 * Useful Examples of ffmpeg and GNU parallel on the command-line
1558 https://dennismungai.wordpress.com/2018/02/06/useful-examples-of-ffmpeg-and-gnu-parallel-on-the-command-line/
1560 * Data Science at the Command Line (Chapter 8.3)
1561 https://www.datascienceatthecommandline.com/
1563 * Bug fixes and man page updates.
1568 * bash / 병렬 https://code.i-harness.com/ko/docs/bash/2a1a
1570 * 15分钟神器gnu parallel 入门观止
1571 http://www.ezilin.com/2018/01/15gnu-parallel.html
1573 * How To Run Multiple Commands In Parallel on Linux
1574 https://www.slashroot.in/how-run-multiple-commands-parallel-linux
1576 * Bug fixes and man page updates.
1581 * env_parset for ash, dash, ksh, sh, zsh
1583 * Automatically create hostgroups if argument ends in @sshlogin
1585 * Tips for running jobs on your VM
1586 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
1588 * Node-local scheduling
1589 https://mogonwiki.zdv.uni-mainz.de/dokuwiki/node_local_scheduling
1591 * GNU Parallel https://docs.computecanada.ca/wiki/GNU_Parallel
1593 * GNU Parallel のエラー処理 https://qiita.com/inouet/items/bfc208668c86caf8ff74
1595 * Using GNU Parallel
1596 https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
1598 * Bug fixes and man page updates.
1603 * Using GNU Parallel to speed up Google Cloud Infrastructure
1605 https://medium.com/@pczarkowski/using-gnu-parallel-to-speed-up-google-cloud-infrastructure-management-53e5c555ec05
1607 * What is gnu parallel
1608 http://wiki.chpc.ac.za/howto:bioinformatics:gnu-parallel
1610 * Parallel, Scripts, Clusters, & Easy Use
1611 https://chiefio.wordpress.com/2017/11/10/parallel-scripts-clusters-easy-use/
1613 * Bug fixes and man page updates.
1618 * Initial support for XDG Base Directory $XDG_* environment variables.
1620 * Validating half a million TIFF files. Part
1622 https://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
1624 * Turing data science class: Cluster computing
1625 https://www.turing.ac.uk/events/masterclass-cluster-computing/
1627 * Butlin:Unix for Bioinformatics - advanced tutorial
1628 https://openwetware.org/wiki/Butlin:Unix_for_Bioinformatics_-_advanced_tutorial
1630 * พยายามใช้ CPU ให้ครบทุก CORE
1631 https://veer66.wordpress.com/2017/09/02/use-multi-core/
1633 * Examples on using GNU Parallel
1634 https://gist.github.com/drmalex07/de8ff1379a560f6d84a0d863e60ae378
1636 * Bug fixes and man page updates.
1641 * Use '--limit myprog' to make a dynamic job limit. Just return 0 to
1642 spawn another job, 1 to not spawn another job, and 2 to kill the
1645 * PARALLEL_RSYNC_OPTS and --rsync-opts sets the options for rsync
1648 * Download all of humble bundle books in parallel
1649 https://til.hashrocket.com/posts/ggt1jaes4y-download-all-of-humble-bundle-books-in-parallel
1651 * Bug fixes and man page updates.
1656 * --line-buffer no longer uses tempfiles. This is faster and makes it
1657 possible for a single process to output more data than there is free
1660 * Vote for GNU Parallel's community ads on
1661 http://meta.unix.stackexchange.com/a/4356/2972
1662 http://meta.askubuntu.com/a/16750/22307
1663 http://meta.serverfault.com/a/9040/45704
1665 * Edit images with GNU Parallel and ImageMagick
1666 https://fedoramagazine.org/edit-images-parallel-imagemagick/
1668 * Running Bash Commands in Parallel
1669 https://dzone.com/articles/running-bash-commands-in-parallel-1
1671 * Today I Learned: GNU parallel, plate tectonics
1672 https://medium.com/@nornagon/today-i-learned-gnu-parallel-plate-tectonics-9fcf24045e63
1674 * GNU Parallel Tutorial
1675 https://www.upf.edu/web/sct-sit/gnu-parallel-tutorial
1677 * Validating half a million TIFF files
1678 http://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
1680 * Blender and GNU Parallel
1681 https://www.blendernation.com/2017/08/16/blender-gnu-parallel/
1683 * Quick Introduction to GNU Parallel
1684 https://github.com/LangilleLab/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel
1686 * A simple distributed animation render example using GNU Parallel
1687 https://gitlab.com/skororu/scripts
1689 * Do stuff on things, in parallel
1690 http://blogs.fluidinfo.com/terry/2017/08/05/do-stuff-on-things-in-parallel/
1692 * Bash And GNU Parallel NGS Bidniz
1693 http://ino.pm/outreach/presentations/2014/03/genomics-wranglers/index.html
1695 * Using for loop vs Gnu parallel for BLAST
1696 http://www.ettemalab.org/using-for-loop-vs-gnu-parallel-for-blast/
1698 * 并行rsync https://gxnotes.com/article/175866.html
1700 * Bug fixes and man page updates.
1705 * Vote for GNU Parallel's community ads on
1706 http://meta.unix.stackexchange.com/a/4356/2972
1707 http://meta.askubuntu.com/a/16750/22307
1708 http://meta.serverfault.com/a/9040/45704
1710 * GNU Parallel was cited in: Hayabusa: Simple and Fast Full-Text
1711 Search Engine for Massive System Log Data
1712 http://dl.acm.org/citation.cfm?id=3095788
1714 * コマンドの並列化を行える『GNU parallel』の個人的使い方まとめ
1715 https://orebibou.com/2017/07/%E3%82%B3%E3%83%9E%E3%83%B3%E3%83%89%E3%81%AE%E4%B8%A6%E5%88%97%E5%8C%96%E3%82%92%E8%A1%8C%E3%81%88%E3%82%8B%E3%80%8Egnu-parallel%E3%80%8F%E3%81%AE%E5%80%8B%E4%BA%BA%E7%9A%84%E4%BD%BF%E3%81%84/
1717 * How to play and play with thousands of digitized 78rpm records
1718 https://blog.archive.org/2017/07/10/how-to-play-and-play-with-78rpm-record-transfers/
1720 * 并行一个for循环 https://gxnotes.com/article/130363.html
1722 * RFC 8142: GeoJSON Text Sequences
1723 https://sgillies.net/2017/05/18/rfc-8142-geojson-text-sequences.html
1725 * Git auto fetch script I run every day
1726 https://lukas.zapletalovi.com/2017/07/git-auto-fetch-script-i-run-every-day.html
1728 * cores, cpus and threads
1729 http://crazyhottommy.blogspot.de/2017/07/cores-cpus-and-threads.html
1731 * Bug fixes and man page updates.
1736 * The command line can now contain \257 (Macron) or UTF characters
1739 * Vote for GNU Parallel's community ads on
1740 http://meta.unix.stackexchange.com/a/4356/2972
1741 http://meta.askubuntu.com/a/16750/22307
1742 http://meta.serverfault.com/a/9040/45704
1744 * Graph for overhead for 1000 jobs has been updated. It remains
1745 steadily at 3.5 ms per job on a 1.7 GHz machine
1746 https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
1748 * GNU Parallel was cited in: The topology of the directed clique
1749 complex as a network invariant
1750 https://springerplus.springeropen.com/articles/10.1186/s40064-016-2022-y
1752 * GNU Parallel was cited in: Improving Optical Character Recognition
1753 of Finnish Historical Newspapers with a Combination of Fraktur &
1754 Antiqua Models and Image
1755 http://www.ep.liu.se/ecp/131/038/ecp17131038.pdf
1757 * GNU Parallel was cited in: Parallel Execution of Structural Mechanic
1758 Tasks with Use of Small Supercomputers
1759 http://www.sciencedirect.com/science/article/pii/S1877705817324815
1761 * GNU Parallel was cited in: Integration of a Multilingual Preordering
1762 Component into a Commercial SMT Platform
1763 https://www.degruyter.com/downloadpdf/j/pralin.2017.108.issue-1/pralin-2017-0009/pralin-2017-0009.pdf
1765 * Tips For Running Jobs On Your VM
1766 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
1768 * Speed up ML model development with GNU Parallel
1769 https://pzelasko.github.io/posts/speed-up-ml-model-development-with-gnu-parallel
1771 * Parallelizing a Python Function for the Extremely Lazy
1772 http://tdhopper.com/blog/2017/Jun/07/parallelizing-a-python-function-for-the-extremely-lazy/
1775 http://www.android5.online/Android/androidjc/androidkf/gykf/201603/8741.html
1777 * Bug fixes and man page updates.
1782 * --timeout can now use s=second,m=minute,h=hour,d=day.
1784 * --dr is now an alias for --dry-run.
1786 * Vote for GNU Parallel's community ads on
1787 http://meta.unix.stackexchange.com/a/4356/2972
1788 http://meta.askubuntu.com/a/16750/22307
1789 http://meta.serverfault.com/a/9040/45704
1791 * GNU Parallel was cited in: Feature Detection in Visual Cortex during
1792 Different Functional States
1793 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5397493/
1795 * GNU Parallel was cited in: From genotype to phenotype: inferring
1796 relationships between microbial traits and genomic components
1797 https://docserv.uni-duesseldorf.de/servlets/DerivateServlet/Derivate-44622/main.pdf
1799 * GNU Parallel was cited in: Designing fecal microbiota transplant
1800 trials that account for differences in donor stool efficacy
1801 http://biorxiv.org/content/biorxiv/early/2016/07/25/065383.full.pdf
1803 * GNU Parallel was cited in: Assessing the predictability of
1804 anharmonic vibrational modes at the example of hydroxyl groups - ad
1805 hoc construction of localised modes and the influence of structural
1806 solute–solvent motifs
1807 http://pubs.rsc.org/-/content/articlelanding/2017/cp/c7cp01662j#!divAbstract
1809 * GNU Parallel was cited in: Mapping Environmental Influences on
1811 ftp://frapftp.fire.ca.gov/outgoing/transfer/PUC_Map1/Utility%20Fire%20map%201%20final%20review%20and%20development%20report21616.pdf
1813 * GNU Parallel was cited in: Weak vs. Strong Disorder Superfluid-Bose
1814 Glass Transition in One Dimension
1815 https://arxiv.org/pdf/1704.02257.pdf
1817 * GNU Parallel was cited in: Online Automatic Post-editing for MT in a
1818 Multi-Domain Translation Environment
1819 https://www.aclweb.org/anthology/E/E17/E17-1050.pdf
1821 * GNU Parallel was cited in: Cross-calibration of S-NPP VIIRS
1822 moderate-resolution reflective solar bands against MODIS Aqua over
1824 http://www.atmos-meas-tech.net/10/1425/2017/amt-10-1425-2017.pdf
1826 * GNU Parallel was cited in: Scattering Networks: Efficient 2D
1827 Implementation And Application To Melanoma Classification
1828 http://amslaurea.unibo.it/12261/1/nurrito_eugenio_tesi_fisica_magistrale.pdf
1830 * GNU Parallel was cited in: Genome-scale detection of positive
1831 selection in 9 primates predicts human-virus evolutionary conflicts
1832 http://biorxiv.org/content/biorxiv/early/2017/04/27/131680.full.pdf
1834 * GNU Parallel is used in: Creates a speech dataset for deep learning
1835 https://github.com/jupiter126/Create_Speech_Dataset
1837 * GNU Parallel is used in: Parse and process the demixing secrets
1838 dataset (DSD100) https://github.com/faroit/dsdtools
1840 * First glance at the gnu parallel utility
1841 https://ibiscybernetics.com/blog/2017-04-05.html
1843 * Installing parallel from source
1844 https://bitsanddragons.wordpress.com/2017/05/03/installing-parallel-from-source/
1846 * How to run command or code in parallel in bash shell under Linux or
1848 https://www.cyberciti.biz/faq/how-to-run-command-or-code-in-parallel-in-bash-shell-under-linux-or-unix/
1850 * Parallel Serial Jobs Using GNU Parallel
1851 http://www.hpc.lsu.edu/training/weekly-materials/2017-Spring/gnuparallel-Feb2017.pdf
1853 * GNU Parallel or How to list millions of S3 objects
1854 https://joeray.me/gnu-parallel-how-to-list-millions-objects.html
1856 * Which Is the Best Tool for Copying a Large Directory Tree Locally?
1857 http://arjon.es/2017/05/11/which-is-the-best-tool-for-copying-a-large-directory-tree-locally/
1859 * Bug fixes and man page updates.
1864 * --halt supports done in addition to success and fail.
1866 * parset will set variables in parallel in Bash.
1868 * Perl 5.6 on Irix is no longer supported.
1870 * Vote for GNU Parallel's community ads on
1871 http://meta.unix.stackexchange.com/a/4356/2972
1872 http://meta.askubuntu.com/a/16750/22307
1873 http://meta.serverfault.com/a/9040/45704
1875 * GNU Parallel was cited in: Halvade-RNA: Parallel variant calling
1876 from transcriptomic data using MapReduce
1877 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0174575
1879 * GNU Parallel was cited in: StrAuto: automation and parallelization
1880 of STRUCTURE analysis
1881 http://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-017-1593-0
1883 * GNU Parallel was cited in: Trespassing the Boundaries: Labeling
1884 Temporal Bounds for Object Interactions in Egocentric Video
1885 https://128.84.21.199/pdf/1703.09026.pdf
1887 * GNU Parallel is used in: https://github.com/lucascbeyeler/zmbackup
1889 * Using GNU Parallel
1890 https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
1892 * Find and xargs and parallel
1893 http://helpful.knobs-dials.com/index.php/Find_and_xargs_and_parallel#Parallel
1895 * Quick Introduction to GNU Parallel
1896 https://github.com/mlangill/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel
1898 * Data science at the command line https://www.slideshare.net/sharatsc/data-science-at-the-command-line
1900 * Bedtools笔记 http://www.jianshu.com/p/67b0665490ac
1902 * Bug fixes and man page updates.
1907 * --rpl can now take arguments by adding '(regexp)' in the replacement
1910 * Vote for GNU Parallel's community ads on
1911 http://meta.unix.stackexchange.com/a/4356/2972
1912 http://meta.askubuntu.com/a/16750/22307
1913 http://meta.serverfault.com/a/9040/45704
1915 * GNU Parallel was cited in: shmlast: An improved implementation of
1916 Conditional Reciprocal Best Hits with LAST and Python
1917 https://joss.theoj.org/papers/3cde54de7dfbcada7c0fc04f569b36c7
1919 * GNU Parallel was cited in: Prediction of relativistic electron flux
1920 in the Earth’s outer radiation belt at geostationary orbit by
1922 https://link.springer.com/article/10.1134/S0016793217010108
1924 * GNU Parallel was cited in: Higher likelihood of multiple bit-flips
1925 due to neutron-induced strikes on logic gates
1926 https://arxiv.org/pdf/1612.08239.pdf
1928 * GNU Parallel was cited in: A Monte Carlo Resampling Approach for the
1929 Calculation of Hybrid Classical and Quantum Free Energies
1930 http://pubs.acs.org/doi/pdfplus/10.1021/acs.jctc.6b00506
1932 * GNU Parallel was cited in: Learning string distance with smoothing
1933 for OCR spelling correction
1934 https://link.springer.com/article/10.1007/s11042-016-4185-5
1936 * GNU Parallel was cited in: The Breakdown of String Perturbation
1937 Theory for Many External Particles
1938 https://arxiv.org/pdf/1611.08003.pdf
1940 * GNU Parallel was cited in: Operations Research Applications in
1942 https://dspace.library.colostate.edu/bitstream/handle/11124/170687/Johnson_mines_0052E_11207.pdf?sequence=1&isAllowed=y
1944 * GNU Parallel was cited in: Parallel Computing: GNU Parallel
1945 http://www.blopig.com/blog/2017/02/parallel-computing-gnu-parallel/
1947 * Stig Sandbeck Mathisen: Change All The Passwords (Again)
1948 http://garf.us/2017/02/stig-sandbeck-mathisen-change-all-the-passwords-again/
1950 * Trabalhando como Paralelismo no Bash usando o GNU Parallel
1951 http://www.beyeler.com.br/2017/03/trabalhando-como-paralelismo-no-bash-usando-o-gnu-parallel/
1953 * GNU parallel と SQL*Loader 組み合わせ実行例
1954 https://blogs.oracle.com/LetTheSunShineIn/entry/gnu_parallel_%E3%81%A8_sql_loader
1956 * Bug fixes and man page updates.
1961 * env_parallel now supports /bin/sh, ash, dash.
1963 * --tee will pipe all data to all jobs. Used with --pipe/--pipepart
1964 and :::. Small example: seq 3333 | parallel --pipe --tee --tag 'grep
1965 {} | wc -l' ::: {0..9}
1967 * If --results {replstr} ends in /: save in dir. Otherwise save as
1968 file. Example: parallel --results {} echo {} ::: a b c
1970 * Vote for GNU Parallel's community ads on
1971 http://meta.unix.stackexchange.com/a/4356/2972
1972 http://meta.askubuntu.com/a/16750/22307
1973 http://meta.serverfault.com/a/9040/45704
1975 * GNU Parallel was cited in: Low-delay forwarding with multiple
1976 candidates for VANETs using multi-criteria decision making
1977 http://ieeexplore.ieee.org/document/7835961/
1979 * GNU Parallel was cited in: An Integrated Simulator and Dataset that
1980 Combines Grasping and Vision for Deep Learning
1981 https://arxiv.org/pdf/1702.02103.pdf
1983 * GNU Parallel was cited in: A Bayesian model selection approach for
1984 identifying differentially expressed transcripts from RNA sequencing
1985 data http://onlinelibrary.wiley.com/doi/10.1111/rssc.12213/full
1987 * GNU Parallel was cited in: The impact of copy number variation on
1988 gout, and the apple genome
1989 https://ourarchive.otago.ac.nz/bitstream/handle/10523/7060/BoocockJames2016MSc.pdf?sequence=3
1991 * GNU Parallel was cited in: Reaction rates for reaction-diffusion
1992 kinetics on unstructured meshes
1993 http://aip.scitation.org/doi/10.1063/1.4975167
1995 * GNU Parallel was cited in: Modeling prediction error improves power
1996 of transcriptome-wide association studies
1997 http://biorxiv.org/content/biorxiv/early/2017/02/14/108316.full.pdf
1999 * GNU Parallel was cited in: Proper experimental design requires
2000 randomization/balancing of molecular ecology experiments
2001 http://biorxiv.org/content/biorxiv/early/2017/02/17/109280.full.pdf
2003 * GNU Parallel was cited in: Experiment-based thermal micromagnetic
2004 simulations of the magnetization reversal for ns-range clocked
2006 http://aip.scitation.org/doi/full/10.1063/1.4974021
2008 * GNU Parallel was cited in: The University of Edinburgh’s systems
2009 submission to the MT task at IWSLT
2010 http://workshop2016.iwslt.org/downloads/IWSLT_2016_paper_27.pdf
2012 * Fast-GBS uses GNU Parallel: https://bitbucket.org/jerlar73/fast-gbs
2014 * Job: DevOps Engineer/Senior Systems Administrator in New York, New
2016 http://rockefeller.jobs/new-york-ny/devops-engineersenior-systems-administrator/2DB3408EAC9E4617AD238550F31C7641/job/
2018 * Training in GNU Parallel:
2019 https://www.carc.unm.edu/education-outreach/workshops--training/
2021 * Training in GNU Parallel:
2022 http://www.hpc.lsu.edu/training/registration.php?topic=Parallel%20Serial%20Jobs%20Using%20GNU%20Parallel&date=February%2022,%202017&time=9:00%20AM%20-%2011:00%20AM&place=307%20Frey&deadline=2017-02-21%2016:30:00
2024 * Batch Convert Images from PNG to JPEG
2025 http://coreygoldberg.blogspot.dk/2017/02/batch-convert-images-from-png-to-jpeg.html
2027 * Accelerating Oxford Nanopore Basecalling
2028 http://fowlerlab.org/2017/01/26/accelerating-oxford-nanopore-basecalling/
2030 * parallel и imagemagick в loop на bash
2031 https://www.linux.org.ru/forum/development/13190247
2033 * Bug fixes and man page updates.
2043 * sql now uses a temporary credentials file for MySQL to avoid
2046 * --sqlmaster and --sqlworker have been reworked.
2048 * --sqlworker only reads from the DBURL: any command and any arguments
2051 * --sqlmaster +DBURL will append different commands to the DBURL and
2052 not erase the table.
2054 * If --results contain a replacement string, no tree structure with
2055 args will be generated.
2057 * --fg --tmux or --fg --tmuxpane will connect to the tmux.
2059 * GNU Parallel was cited in: Fast, Automated Indoor Light Detection,
2060 Classification, and Measurement
2061 https://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-212.pdf
2063 * GNU Parallel was cited in: Unbiased RNA Shotgun Metagenomics in
2064 Social and Solitary Wild Bees Detects Associations with Eukaryote
2065 Parasites and New Viruses
2066 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0168456
2068 * GNU Parallel was cited in: Almost Event-Rate Independent Monitoring
2069 of Metric Temporal Logic
2070 http://people.inf.ethz.ch/trayteld/papers/tacas17-aerial/aerial.pdf
2072 * 使用GNU parallel命令并行预处理数据: https://blog.razrlele.com/p/1843
2074 * GNU Parallel as a queuing system:
2075 http://puntoblogspot.blogspot.com/2017/01/gnu-parallel-as-queuing-system.html
2077 * AWS re:Invent 2016: Deep Dive on Amazon Elastic File System (STG202)
2079 http://www.slideshare.net/AmazonWebServices/aws-reinvent-2016-deep-dive-on-amazon-elastic-file-system-stg202
2080 and https://youtu.be/PlTuJx4VnGw?t=30m16s
2082 * Bug fixes and man page updates.
2087 * --results foo.csv will save output as a CSV-file. Can be directly
2088 imported into R or LibreCalc.
2090 * When using --pipepart a negative --block-size is not interpreted as
2091 a block size but as the number of blocks each jobslot should have.
2093 * --sqlmaster/--sqlandworker will append jobs to the DBURL if the
2094 DBURL is prepended with +.
2096 * GNU Parallel was cited in: A cloud-based workflow to quantify
2097 transcript-expression levels in public cancer compendia
2098 http://www.nature.com/articles/srep39259
2100 * GNU Parallel was cited in: Determination of crystal structures of
2101 proteins of unknown identity using a marathon molecular replacement
2102 procedure: Structure of Stenotrophomonas maltophilia
2103 phosphate-binding protein
2104 https://www.researchgate.net/publication/308186413_Determination_of_crystal_structures_of_proteins_of_unknown_identity_using_a_marathon_molecular_replacement_procedure_Structure_of_Stenotrophomonas_maltophilia_phosphate-binding_protein
2106 * GNU Parallel was cited in: Large-scale benchmarking reveals false
2107 discoveries and count transformation sensitivity in 16S rRNA gene
2108 amplicon data analysis methods used in microbiome studies
2109 http://microbiomejournal.biomedcentral.com/articles/10.1186/s40168-016-0208-8
2111 * GNU Parallel was cited in: Decomposing Images into Layers via
2113 https://cs.gmu.edu/~ygingold/singleimage/Decomposing%20Images%20into%20Layers%20via%20RGB-space%20Geometry%20(Tan%20et%20al%202016%20TOG)%20small.pdf
2115 * Transient compute clustering with GNU Parallel and sshfs
2116 https://gist.github.com/Brainiarc7/24c966c8a001061ee86cc4bc05826bf4
2118 * 4 Ways to Batch Convert Your PNG to JPG and Vice-Versa
2119 http://www.tecmint.com/linux-image-conversion-tools/
2121 * All's Fair in Love and Distributed Storage
2122 http://cohesity.com/blog/alls-fair-love-distributed-storage/
2124 * How can I use GNU Parallel to run a lot of commands in parallel
2125 https://www.msi.umn.edu/support/faq/how-can-i-use-gnu-parallel-run-lot-commands-parallel
2127 * 정해영의 블로그 - JEONG Haeyoung's blog
2128 http://blog.genoglobe.com/2016/11/gnu-parallel.html
2130 * 在Linux下将PNG和JPG批量互转的四种方法
2131 http://os.51cto.com/art/201612/524182.htm
2133 * Running in parallel http://tomkimpson.com/howto/gnuparallel/
2135 * Taco Bell Parallel Programming
2136 https://giorgos.sealabs.net/taco-bell-parallel-programming.html
2138 * Bug fixes and man page updates.
2143 * --record-env can now be used with env_parallel for bash, ksh, pdksh,
2146 * GNU Parallel was cited in: An improved implementation of Conditional
2147 Reciprocal Best Hits with LAST and Python
2148 https://pypi.python.org/pypi/shmlast/1.0.3
2150 * GNU Parallel was cited in: miRPathDB: a new dictionary on microRNAs
2152 http://nar.oxfordjournals.org/content/early/2016/10/13/nar.gkw926.full
2154 * GNU/Parallel – Run multiple commands simultaneously
2155 https://vinusumi.wordpress.com/2016/11/08/gnuparallel-run-multiple-commands-simultaneously/
2157 * Tutorial: Parallel web scraping with CasperJS and GNU Parallel
2158 http://g-liu.com/blog/2016/10/tutorial-parallel-web-scraping-with-casperjs-and-gnu-parallel/
2160 * Bug fixes and man page updates.
2165 * First command no longer gets stdin as it causes unpredictable issues.
2167 * GNU Parallel was cited in: Efficiently parallelized modeling of
2168 tightly focused, large bandwidth laser pulses
2169 https://arxiv.org/pdf/1609.08146v1.pdf
2171 * How to crunch lots of geodata in parallel
2172 http://blog.faraday.io/how-to-crunch-lots-of-geodata-in-parallel/
2174 * GNU parallel is my new toaster
2175 http://amedee.me/gnu-parallel-is-my-new-toaster/index.html
2177 * Bug fixes and man page updates.
2182 * parcat - cat files or fifos in parallel
2184 * GNU Parallel was cited in: Velocity: A Netflow Based Optimized
2186 https://mospace.umsystem.edu/xmlui/bitstream/handle/10355/50842/Thesis_2016_Pakhare.pdf?sequence=1&isAllowed=y
2188 * GNU Parallel was cited in: Viral deep sequencing needs an adaptive
2189 approach: IRMA, the iterative refinement meta-assembler
2190 http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5011931/
2192 * Using GNU Parallel and ImageMagick for Conversions
2193 https://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
2195 * Training in GNU Parallel
2196 http://www.cism.ucl.ac.be/Services/Formations/parcomp.pdf
2198 * Chown Ceph OSD data directory using GNU Parallel
2199 http://blog.widodh.nl/2016/08/chown-ceph-osd-data-directory-using-gnu-parallel/
2201 * FastGBS uses GNU Parallel https://bitbucket.org/jerlar73/fastgbs
2203 * dDocent: A guide to ddRAD sequencing
2204 https://ddocent.wordpress.com/ddocent-pipeline-user-guide/
2206 * SOFTWARE GNU Parallel
2207 http://msi-riss.readthedocs.io/en/latest/software/gnu-parallel.html
2209 * Bug fixes and man page updates.
2214 * --tmuxpane opens jobs in panes in tmux. Useful if you want to
2215 monitor progress of less than 100 simultaneous jobs.
2217 * --linebuffer now treats \r as line ending, too.
2219 * Perl changes forces use of floats to be given with leading zero, so
2222 * --xapply renamed to --link.
2224 * Support for pdksh will fade until someone packages it for Ubuntu 16.
2226 * GNU Parallel was cited in: Exome sequencing of geographically
2227 diverse barley landraces and wild relatives gives insights into
2228 environmental adaptation
2229 http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3612.html?WT.feed_name=subjects_genetics#references
2231 * GNU Parallel was cited in: Vision-Enhanced Lidar Odometry and
2232 Mapping https://www.ri.cmu.edu/pub_files/2016/8/DLL-thesis.pdf
2234 * Easy parallelization with GNU parallel
2235 http://mpharrigan.com/2016/08/02/parallel.html
2237 * Facebook V: Predicting Check Ins, Winner's Interview: 2nd Place,
2239 http://blog.kaggle.com/2016/08/02/facebook-v-predicting-check-ins-winners-interview-2nd-place-markus-kliegl/
2242 http://www.manitou-mail.org/blog/2016/07/parallel-import/
2244 * Large file batch processing using NodeJs and GNU Parallel
2245 http://www.zacorndorff.com/2016/07/27/large-file-batch-processing-using-nodejs-and-gnu-parallel/
2247 * Bug fixes and man page updates.
2252 * env_parallel is now ready for wider testing. It is still beta
2255 * env_parallel is heavily modified for all shells and testing has been
2258 * Selectively choosing what to export using --env now works for
2259 env_parallel (bash, csh, fish, ksh, pdksh, tcsh, zsh).
2261 * --round-robin now gives more work to a job that processes faster
2262 instead of same amount to all jobs.
2264 * --pipepart works on block devices on GNU/Linux.
2266 * GNU Parallel was cited in: HybPiper: Extracting Coding Sequence and
2267 Introns for Phylogenetics from High-Throughput Sequencing Reads
2268 Using Target Enrichment
2269 http://www.bioone.org/doi/full/10.3732/apps.1600016
2271 * GNU Parallel was cited in: StrAuto - Automation and Parallelization
2272 of STRUCTURE Analysis
2273 http://www.crypticlineage.net/download/strauto/strauto_doc.pdf
2275 * GNU Parallel was cited in: Tools and techniques for computational
2277 http://gigascience.biomedcentral.com/articles/10.1186/s13742-016-0135-4
2279 * GNU Parallel was cited in: FlashPCA: fast sparse canonical
2280 correlation analysis of genomic data
2281 http://biorxiv.org/content/biorxiv/suppl/2016/04/06/047217.DC1/047217-1.pdf
2283 * GNU Parallel was cited in: Math Indexer and Searcher under the Hood:
2284 Fine-tuning Query Expansion and Unification Strategies
2285 http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings12/pdf/ntcir/MathIR/05-NTCIR12-MathIR-RuzickaM.pdf
2287 * GNU Parallel was cited in: The Evolution and Fate of
2288 Super-Chandrasekhar Mass White Dwarf Merger Remnants
2289 http://arxiv.org/pdf/1606.02300.pdf
2291 * GNU Parallel was cited in: Evaluation of Coastal Scatterometer
2293 https://mdc.coaps.fsu.edu/scatterometry/meeting/docs/2016/Thu_AM/coastal-poster.pdf
2295 * GNU Parallel was used in: https://github.com/splitice/bulkdnsblcheck
2297 * The iconv slurp misfeature
2298 http://www.openfusion.net/linux/iconv_slurp_misfeature
2300 * แบบว่า CPU เหลือ https://veer66.wordpress.com/2016/06/15/gnu-parallel/
2302 * Bug fixes and man page updates.
2307 * $PATH can now be exported using --env PATH. Useful if GNU Parallel
2308 is not in your path on remote machines.
2310 * If --block is left out, --pipepart will use a block size that will
2311 result in 10 jobs per jobslot.
2313 * The cookie from 2016-01-04 was won by Morgan Rodgers on the
2314 2016-06-06 after 5 months.
2316 * Vote for GNU Parallel's community ad on
2317 https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
2319 * GNU Parallel was cited in: Genotypic Resistance Tests Sequences
2320 Reveal the Role of Marginalized Populations in HIV-1 Transmission in
2321 Switzerland http://www.nature.com/articles/srep27580
2323 * GNU Parallel was cited in: A Deep-Learning Approach for Operation of
2324 an Automated Realtime Flare Forecast
2325 https://arxiv.org/pdf/1606.01587.pdf
2327 * Unix parallel: Populating all the USB sticks
2328 http://www.markhneedham.com/blog/2016/06/01/unix-parallel-populating-all-the-usb-sticks/
2330 * GNU Parallel is a fantastic utility https://www.dray.be/parallel/
2332 * Combining a large number of VCF files
2333 https://gtamazian.com/2016/06/16/combining-a-large-number-of-vcf-files/
2335 * Useful Scraping Techniques
2336 http://blog.apps.npr.org/2016/06/17/scraping-tips.html
2338 * Tools of the trade
2339 http://onox.com.br/2015/05/tools-of-the-trade/#more-198
2341 * Armslist scraper https://github.com/nprapps/armslist-scraper/
2343 * Bug fixes and man page updates.
2348 * niceload --net pauses the program if the internet connection is
2351 * Vote for GNU Parallel's community ad on
2352 https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
2354 * Updated speed comparison between versions
2355 https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
2357 * GNU Parallel was cited in: Improving computation efficiency by
2358 parallel programming
2359 http://www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?C21COM=2&I21DBN=UJRN&P21DBN=UJRN&IMAGE_FILE_DOWNLOAD=1&Image_file_name=PDF/ape_2013_3_44.pdf
2361 * GNU Parallel was cited in: A supernova feedback implementation for
2362 the astrophysical simulation software Arepo
2363 https://arxiv.org/abs/1604.06071
2365 * GNU Parallel was cited in: Lorenz-Mie theory for 2D scattering and
2366 resonance calculations https://arxiv.org/pdf/1505.07691v2.pdf
2368 * GNU Parallel was cited in: Host-pathogen co-evolution and the
2369 emergence of broadly neutralizing antibodies in chronic infections
2370 https://arxiv.org/abs/1512.06296
2372 * GNU Parallel was cited in: Pacific People, Metabolic Disease and
2373 Evolutionary Processes: a mitochondrial DNA study
2374 https://otago.ourarchive.ac.nz/handle/10523/6340
2376 * GNU Parallel was cited in: The effect of domain modeling on
2377 efficiency of planning: Lessons from the Nomystery domain
2378 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7407131
2380 * GNU Parallel was cited in: Oops, my tests broke the build: An
2381 analysis of Travis CI builds with GitHub
2382 https://peerj.com/preprints/1984/
2384 * GNU Parallel was cited in: Drosophila Muller F Elements Maintain a
2385 Distinct Set of Genomic Properties Over 40 Million Years of
2386 Evolution http://www.g3journal.org/content/5/5/719.full.pdf+html
2388 * GNU Parallel was cited in: An Empirical Comparison of Neural
2389 Architectures for Reinforcement Learning in Partially Observable
2391 http://biorxiv.org/content/biorxiv/early/2016/03/24/022707.full.pdf
2393 * GNU Parallel was cited in: PleaseTM: Enabling Transaction Conflict
2394 Management in Requester-wins Hardware Transactional Memory
2395 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7446072
2397 * GNU Parallel was cited in: EASE-MM: Sequence-Based Prediction of
2398 Mutation-Induced Stability Changes with Feature-Based Multiple
2400 http://www.sciencedirect.com/science/article/pii/S0022283616000310
2402 * GNU Parallel was cited in: A new orthology assessment method for
2403 phylogenomic data: Unrooted Phylogenetic Orthology
2404 http://mbe.oxfordjournals.org/content/early/2016/04/06/molbev.msw069.short
2405 https://github.com/ballesterus/UPhO
2407 * GNU Parallel was cited in: Distinctive Interest Point Selection for
2408 Efficient Near-duplicate Image Retrieval
2409 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7459172
2411 * GNU Parallel was cited in: The Evolution of C Programming Practices:
2412 A Study of the Unix Operating System 1973–2015
2413 https://dl.acm.org/citation.cfm?id=2884799 (It has the cutest
2414 thumbnail graphs I have ever seen scattered all over the text)
2416 * GNU Parallel was cited in: Data processing pipeline for serial
2417 femtosecond crystallography at SACLA
2418 http://journals.iucr.org/j/issues/2016/03/00/zw5001/index.html
2420 * GNU Parallel was cited in: Reconstruction of Fine-Scale Auroral
2421 Dynamics http://arxiv.org/pdf/1512.01460.pdf
2423 * GNU Parallel was cited in: Genomic legacy of the African cheetah,
2425 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4676127/pdf/13059_2015_Article_837.pdf
2427 * GNU Parallel was cited in: Don’t Forget to Lock the Back Door! A
2428 Characterization of IPv6 Network Security Policy
2429 http://benign-research-probe2.eecs.umich.edu/ndss16_ipv6_final.pdf
2431 * GNU Parallel was cited in: Comprehensive Annotation of the
2432 Parastagonospora nodorum Reference Genome Using Next-Generation
2433 Genomics, Transcriptomics and Proteogenomics
2434 http://journals.plos.org/plosone/article/asset?id=10.1371%2Fjournal.pone.0147221.PDF
2436 * GNU Parallel was cited in: How attention influences perceptual
2437 decision making: Single-trial EEG correlates of drift-diffusion
2438 model parameters http://www.cidlab.com/prints/nunez2016attention.pdf
2440 * GNU Parallel was cited in: Telomere And Proximal Sequence Analysis
2441 Using High-Throughput Sequencing Reads
2442 http://repository.upenn.edu/edissertations/1460/
2444 * GNU Parallel was cited in: AT-GIS: Highly Parallel Spatial Query
2445 Processing with Associative Transducers
2446 http://lsds.doc.ic.ac.uk/sites/default/files/ATGIS-SIGMOD16.pdf
2448 * GNU Parallel was cited in: PVAIR: Partial Variable Assignment
2449 InterpolatoR http://verify.inf.usi.ch/sites/default/files/main-2.pdf
2451 * GNU Parallel was cited in: Comparative Cladistics: Fossils,
2452 Morphological Data Partitions and Lost Branches in the Fossil Tree
2453 of Life http://opus.bath.ac.uk/43955/
2455 * GNU Parallel was cited in: Shannon: An Information-Optimal de
2456 NovoRNA-Seq Assembler
2457 http://biorxiv.org/content/biorxiv/early/2016/02/09/039230.full.pdf
2459 * GNU Parallel was cited in: Adaptive Measure-Theoretic Parameter
2460 Estimation for Coastal Ocean Modeling
2461 https://repositories.lib.utexas.edu/handle/2152/32435
2463 * GNU Parallel was cited in: Computational Design of DNA-Binding
2465 http://link.springer.com/protocol/10.1007/978-1-4939-3569-7_16
2467 * GNU Parallel was cited in: Reference genotype and exome data from an
2468 Australian Aboriginal population for health-based research
2469 http://www.nature.com/articles/sdata201623
2471 * GNU Parallel was cited in: Do aye-ayes echolocate?
2472 http://biorxiv.org/content/biorxiv/early/2016/04/11/048165.full.pdf
2474 * GNU Parallel was cited in: Functional enrichments of disease
2475 variants across thousands of independent loci in eight diseases
2476 http://biorxiv.org/content/biorxiv/early/2016/04/11/048066.full.pdf
2478 * GNU Parallel was cited in: From genomes to phenotypes: Traitar, the
2479 microbial trait analyzer
2480 http://biorxiv.org/content/biorxiv/early/2016/03/12/043315.full.pdf
2482 * GNU Parallel was mentioned in: Fast Playback Framework for Analysis
2483 of Ground-Based Doppler Radar Observations Using MapReduce
2485 http://journals.ametsoc.org/doi/pdf/10.1175/JTECH-D-15-0118.1
2487 * NCBI blast tutorial
2488 https://github.com/enormandeau/ncbi_blast_tutorial
2490 * Distributed Preservation Made Simple
2491 https://blog.archive.org/2016/02/26/distributed-preservation-made-simple/
2493 * Parallel Jobs in Luigi http://rjbaxley.com/posts/2016/03/13/parallel_jobs_in_luigi.html
2495 * Bug fixes and man page updates.
2500 * :::+ and ::::+ work like ::: and :::: but links this input source to
2501 the previous input source in a --xapply fashion. Contrary to
2502 --xapply values do not wrap: The shortest input source determines
2505 * --line-buffer --keep-order now outputs continously from the oldest
2506 job still running. This is more what you would expect than the
2507 earlier behaviour where --keep-order had no effect with
2510 * env_parallel supports tcsh, csh, pdksh. In fish it now supports
2511 arrays. In csh/tcsh it now supports variables, aliases, and arrays
2512 with no special chars. In pdksh it supports aliases, functions,
2513 variables, and arrays.
2515 * Function exporting on Mac OS X works around old Bash version.
2517 * Better CPU detection on OpenIndiana.
2519 * GNU Parallel was cited in: Automatic Methods for Assisted
2521 https://www.researchgate.net/publication/297738658_Automatic_Methods_for_Assisted_Recruitment
2523 * GNU Parallel was cited in: Reinterpretation of ATLAS 8 TeV searches
2524 for Natural SUSY with a R-Sneutrino LSP
2525 http://arxiv.org/pdf/1603.06130.pdf
2527 * GNU Parallel was cited in: An Operational Radiometric Landsat
2528 Preprocessing Framework for Large-Area Time Series Applications
2529 https://www.uni-trier.de/fileadmin/fb6/prof/FER/Publikationen/frantz_et_al_ieee-tgrs-2016-post-print.pdf
2531 * A basic demo of how GNU Parallel can speed up execution of commands
2532 https://www.youtube.com/watch?v=kl8LO2jcvMc
2534 * qbatch uses GNU Parallel: https://pypi.python.org/pypi/qbatch/1.0rc2
2536 * FaceCrop uses GNU Parallel: https://github.com/EderSantana/FaceCrop
2538 * Parallel Processing with Catmandu
2539 https://librecatproject.wordpress.com/2016/04/20/parallel-processing-with-catmandu/
2542 http://staypython.blogspot.dk/2016/04/gnu-parallel.html
2544 * Bug fixes and man page updates.
2549 * env_parallel is a function that exports the environment (functions,
2550 aliases, variables, and arrays) to GNU Parallel. Run 'man
2551 env_parallel' for details.
2553 * niceload --prg now searches for substrings if no process with the
2556 * GNU Parallel was cited in: Random Forest DBSCAN for USPTO Inventor
2557 Name Disambiguation http://arxiv.org/pdf/1602.01792.pdf
2559 * GNU Parallel was mentioned (with wrong citation) in: Dual Level
2560 Parallel Computations for LargeScale High-Fidelity Database to
2561 Design Aerospace Vehicles
2562 http://www.nas.nasa.gov/assets/pdf/papers/Guruswamy_2013_DualLevelParallelComputations.pdf
2564 * Using ‘Parallel’ in Unix
2565 https://shearnrylan.wordpress.com/2016/02/22/using-parallel-in-unix/
2567 * JPEG Squish uses (and co-distributes) GNU Parallel:
2568 http://dantidswell.co.uk/jpeg-squish/
2570 * Bug fixes and man page updates.
2575 * Vote for new community on Superuser, Ask Ubuntu, Unix&Linux
2576 http://meta.superuser.com/questions/11127/community-promotion-ads-2016/11225#11225
2577 http://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
2578 http://meta.unix.stackexchange.com/questions/3854/community-promotion-ads-2016/3893#3893
2580 * Daily Quick Tip: parallel
2581 https://medium.com/@jacaetevha/daily-quick-tip-parallel-8772435f6582
2583 * Downloading a list of URLs
2584 http://blog.gypsydave5.com/2016/02/04/xargs-and-curl/
2586 * Using GNU Parallel and ImageMagick for Conversions
2587 http://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
2589 * Running bash commands in parallel
2590 http://linuxcommando.blogspot.dk/2016/01/running-bash-commands-in-parallel.html
2592 * parallel processing in PDAL
2593 https://smathermather.wordpress.com/2016/01/28/parallel-processing-in-pdal/
2595 * A Million Text Files And A Single Laptop
2596 http://randyzwitch.com/gnu-parallel-medium-data/
2598 * 「今日から使い切る」ための GNU Parallelによる並列処理入門
2599 http://www.slideshare.net/koji_matsuda/gnu-parallel
2601 * Bug fixes and man page updates.
2606 * --sql DBURL uses DBURL as storage for jobs and output. It does not
2607 run any jobs so it requires at least one --sqlworker. DBURL must
2610 * --sqlworker DBURL gets jobs from DBURL and stores the result back to
2613 * --sqlandworker is a shorthand for --sql and --sqlworker.
2615 * --sqlworker requires the output of a single job to fit in memory.
2617 * --results now also saves a file called 'seq' containing the sequence
2620 * If $PARALLEL_ENV is a file, then that file will be read into
2623 * man parallel_tutorial has been given an overhaul.
2625 * --workdir now accepts replacementstrings.
2627 * GNU Parallel was cited in: Possum - A Framework for
2628 Three-Dimensional Reconstruction of Brain Images from Serial
2629 Sections http://link.springer.com/article/10.1007/s12021-015-9286-1
2631 * GNU Parallel was cited in: A Genetic Algorithm for the selection of
2632 structural MRI features for classification of Mild Cognitive
2633 Impairment and Alzheimer's Disease
2634 http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=7359909&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7359909
2636 * GNU Parallel was cited in: The Effect of Domain Modeling on
2637 Performance of Planning Algorithms
2638 http://isaim2016.cs.virginia.edu/papers/ISAIM2016_Bartak_Vodrazka.pdf
2640 * Plotting time tables for jobs run by GNU Parallel
2641 https://github.com/ziotom78/plot_joblog
2643 * GNU Parallel was used in: Mission Impossible: you have 1 minute to
2644 analyze the Ebola Genome https://www.biostars.org/p/119397
2646 * GNU Parallel is used in LAST: http://last.cbrc.jp/
2648 * Distributed Log Search Using GNU Parallel
2649 http://codehate.com/blog/2015/12/01/distributed-log-search-using-gnu-parallel/
2651 * Bug fixes and man page updates.
2656 * --transfer is now an alias for --transferfile {}.
2658 * --transferfile works like --transfer, but takes an argument like
2659 --return. This makes it possible to combine transferring files
2660 with multiple input sources: parallel -S server --tf {1} wc {2}
2661 {1} ::: * ::: -l -w -c
2663 * total_jobs() can now be used in {= =}: parallel echo job {#} of '{=
2664 $_=total_jobs() =}' ::: {1..50}
2666 * GNU Parallel was cited in: Evolution and Learning in Heterogeneous
2668 http://research.gold.ac.uk/15078/1/COM_thesis_JonesD_2015.pdf
2670 * GNU Parallel was cited in: Achieving Consistent Doppler Measurements
2671 from SDO/HMI Vector Field Inversions
2672 http://arxiv.org/pdf/1511.06500.pdf
2674 * Flo uses GNU Parallel: https://github.com/wurmlab/flo
2676 * 使用 GNU parallel 來平行運算
2677 http://mutolisp.logdown.com/posts/316959-using-gnu-parallel-to-parallel-computing
2679 * Bug fixes and man page updates.
2684 * GNU Parallel packaged for CERN CentOS:
2685 http://linuxsoft.cern.ch/cern/centos/7/cern/x86_64/repoview/parallel.html
2687 * GNU Parallel was cited in: The Outer Solar System Origins Survey:
2688 I. Design and First-Quarter Discoveries
2689 http://arxiv.org/pdf/1511.02895.pdf
2691 * GNU Parallel was cited in: Contrasting genetic architectures of
2692 schizophrenia and other complex diseases using fast
2693 variance-components analysis
2694 http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3431.html
2696 * GNU Parallel was cited in: Named-Entity Chunking for Norwegian Text
2697 using Support Vector Machines
2698 http://ojs.bibsys.no/index.php/NIK/article/viewFile/248/211
2700 * GNU Parallel was cited in: Multiscale Estimation of Binding Kinetics
2701 Using Brownian Dynamics, Molecular Dynamics and Milestoning
2702 http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004381#pcbi.1004381.ref072
2704 * GNU Parallel was cited in: A Detailed Characterization of Errors in
2705 Logic Circuits due to Single-Event Transients
2706 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=7302348&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7302348
2708 * GNU Parallel was cited in: Arabic Speaker Emotion Classification
2709 Using Rhythm Metrics and Neural Networks
2710 http://www.eurasip.org/Proceedings/Eusipco/Eusipco2015/papers/1570104855.pdf
2712 * GNU Parallel was cited in: Stride Search: a general algorithm for
2713 storm detection in high resolution climate data
2714 http://www.geosci-model-dev-discuss.net/8/7727/2015/gmdd-8-7727-2015.pdf
2716 * GNU Parallel was cited in: Decomposing Digital Paintings into Layers
2717 via RGB-space Geometry http://arxiv.org/pdf/1509.03335.pdf
2719 * GNU Parallel was cited in: Structure and evolutionary history of a
2720 large family of NLR proteins in the zebrafish
2721 http://www.biorxiv.org/content/biorxiv/early/2015/09/18/027151.full.pdf
2723 * GNU Parallel was cited in: Evolution of movement strategies under
2724 competitive interactions
2725 http://digital.csic.es/bitstream/10261/115973/1/evolution_movement_strategies_Kiziridis.pdf
2727 * Automating large numbers of tasks
2728 https://rcc.uchicago.edu/docs/tutorials/kicp-tutorials/running-jobs.html
2730 * Max out your IOPs with GNU Parallel
2731 http://blog.bitratchet.com/2015/11/11/max-out-your-iops-with-gnu-parallel/
2733 * Bug fixes and man page updates.
2738 * --plus makes it possible to use {##} as a shorthand for
2739 {= $_=$Global::JobQueue->total_jobs() =} which gives the the number
2740 of jobs to run in total.
2742 * {= $_=$Global::JobQueue->total_jobs() =} is incompatible with -X,
2745 * GNU Parallel is now mostly compatible with lsh
2746 (http://www.lysator.liu.se/~nisse/lsh/) and somewhat compatible with
2747 autossh (http://www.harding.motd.ca/autossh/).
2749 * --workdir ... now also works when run locally.
2751 * GNU Parallel was cited in: There is no (75, 32, 10, 16) strongly
2752 regular graph http://arxiv.org/pdf/1509.05933.pdf
2754 * GNU Parallel was cited in: Roary: rapid large-scale prokaryote pan
2756 http://bioinformatics.oxfordjournals.org/content/early/2015/08/05/bioinformatics.btv421.full.pdf+html
2758 * GNU Parallel is used in TraitAR:
2759 https://testpypi.python.org/pypi/traitar/0.1.4
2761 * A parallel and fast way to download multiple files
2762 http://onetipperday.blogspot.com/2015/10/a-parallel-and-fast-way-to-download.html
2764 * Usar GNU Parallel para aumentar el rendimiento de tus scripts
2765 http://adrianarroyocalle.github.io/blog/2015/10/20/usar-gnu-parallel/
2767 * Bug fixes and man page updates.
2772 * GNU Parallel was cited in: Flexible Modeling of Epidemics with an
2773 Empirical Bayes Framework
2774 http://journals.plos.org/ploscompbiol/article?id=10.1371%2Fjournal.pcbi.1004382
2776 * GNU Parallel was cited in: BL1: 2D Potts Model with a Twist
2777 https://sucs.swan.ac.uk/~rjames93/Dissertation.pdf
2779 * GNU Parallel was cited in: A Scalable Parallel Implementation of
2780 Evolutionary Algorithms for Multi-Objective Optimization on GPUs
2781 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7257074
2783 * GNU Parallel was cited in: How Can We Measure the Similarity Between
2784 Résumés of Selected Candidates for a Job?
2785 https://www.researchgate.net/publication/275954089_How_can_we_measure_the_similarity_between_rsums_of_selected_candidates_for_a_job
2787 * GNU Parallel was cited in: Interplay of cell dynamics and epithelial
2788 tension during morphogenesis of the Drosophila pupal wing
2789 http://www.researchgate.net/profile/Raphael_Etournay/publication/279061859_Interplay_of_cell_dynamics_and_epithelial_tension_during_morphogenesis_of_the_Drosophila_pupal_wing/links/558a95ad08aeae8413bcceea.pdf
2791 * Third-party selling GNU Parallel T-shirts
2792 http://www.aliexpress.com/item/2015F-BSO-GNU-LOGO-GNU-PARALLEL-men-s-shirt-sleeve-visual-illusion-error/32464827966.html
2794 * Joys of gnu parallel
2795 http://scottolesen.com/index.php/2015/08/26/joys-of-gnu-parallel/
2797 * Crop and resize images with bash and ImageMagick
2798 https://www.simonholywell.com/post/2015/08/image-resize-crop-bash-imagemagick/
2800 * Three Ways to Script Processes in Parallel
2801 http://www.codeword.xyz/2015/09/02/three-ways-to-script-processes-in-parallel/
2803 * What It Looks Like to Process 3.5 Million Books
2804 http://blog.gdeltproject.org/what-it-looks-like-to-process-3-5-million-books/
2806 * Bug fixes and man page updates.
2811 * If $job->skip() is called in {= =} the job will not be run.
2813 * @arg can now be used in {= =}: parallel echo '{= $arg[2] < 5 and
2814 $_="j" =}' ::: 1 2 3 ::: 4 5 6
2816 * Version of GNU Parallel that uses PostgreSQL as backend
2817 https://github.com/stephen-fralich/parallel-sql/
2819 * SpeedSeq: ultra-fast personal genome analysis and interpretation
2820 http://www.nature.com/nmeth/journal/vaop/ncurrent/full/nmeth.3505.html
2822 * GNU Parallel is used in elPrep: https://github.com/ExaScience/elprep
2824 * Who actually reads the code?
2825 http://www.fsf.org/blogs/community/who-actually-reads-the-code
2827 * Introduction to GNU Parallel
2828 http://erictleung.com/2015/08/06/intro-to-gnu-parallel/
2830 * ¿Alguien se lee el código?
2831 http://www.taringa.net/post/linux/18854759/Alguien-se-lee-el-codigo.html
2833 * ¿Quién se lee el código fuente?
2834 https://victorhckinthefreeworld.wordpress.com/2015/08/12/quien-se-lee-el-codigo-fuente/
2836 * Distribution des traitements avec GNU Parallel
2837 http://blog.inovia-conseil.fr/?p=226#4
2839 * Эксперимент по проверке, читают ли код открытых проектов
2840 http://www.opennet.ru/opennews/art.shtml?num=42718
2842 * 多核心主機搭配 GNU parallel
2843 http://blog.zeroplex.tw/2015/08/gnu-parallel.html
2845 * Bug fixes and man page updates.
2850 * If a record fits in a block, --block only reads upto the size of
2851 --block. If not: --block reads a full --block more.
2853 * Due to widely spread distributions still using --tollef even after a
2854 year of being retired following a year of being obsolete, --tollef
2855 now gives an error unless used with --gnu.
2857 * --nice now uses a perl wrapper instead of the nice command.
2859 * Cookie 2013-08-18 was won by Mark Maimone, 1 year and 11 months
2862 * A parser for GNU Parallel --joblog files:
2863 https://github.com/harryjubb/joblog
2865 * GNU Parallel was cited in: Dynamical formation & scattering of
2866 hierarchical triples: Cross sections, Kozai-Lidov oscillations, and
2867 collisions http://arxiv.org/pdf/1507.03593.pdf
2869 * GNU Parallel was cited in: A Fast Compiler for NetKAT
2870 http://arxiv.org/pdf/1506.06378.pdf
2872 * GNU Parallel was cited in: Decomposing Time-Lapse Paintings into
2874 http://cs.gmu.edu/~ygingold/timemap/Decomposing%20Time-Lapse%20Paintings%20into%20Layers%20(Tan%20et%20al%202015%20SIGGRAPH)%20600dpi.pdf
2876 * GNU Parallel was used in: Somatic mutation calling from the matched
2877 tumor-normal exome-sequencing
2878 http://fafner.meb.ki.se/biostatwiki/somac/
2880 * Parallel Processing from the Command Line
2881 https://www.perpetual-beta.org/weblog/parallel-processing-from-the-command-line.html
2883 * Using GNU Parallel to speed up network operations
2884 http://vielmetti.typepad.com/vacuum/2015/06/using-gnu-parallel-to-speed-up-network-operations.html
2886 * Crawl faster with "parallel" - but how fast?
2887 http://andreas-wpv.blogspot.com/2015/07/crawl-faster-with-parallel-but-how-fast.html
2889 * Simultaneously benchmark many URLs with ApacheBench and GNU parallel
2890 https://www.simonholywell.com/post/2015/06/parallel-benchmark-many-urls-with-apachebench/
2892 * Bug fixes and man page updates.
2897 * --halt has been rewritten completely. You can now combine
2898 percentages with success or fail. See the man page.
2900 * Exit values 102..254 have been removed. 101 means more than 100 jobs
2903 * Killing through --timeout, --memfree, or --halt is now done as a
2906 * --termseq determines which signals are sent when a job is killed.
2908 * An empty argument would previously cause no string to be
2909 inserted. This is now changed to '' being inserted, thus prepending
2910 a space to the output of: parallel echo {} b ::: ''
2912 * $PARALLEL_ENV can now be set to an environment prepending the
2913 command. Used in env_parallel as mentioned in the manpage.
2915 * --retry-failed will retry all failed jobs in a joblog. It will
2916 ignore any command given.
2918 * --ssh and $PARALLEL_SSH can be used to set the command used for
2919 ssh. The command is assumed to behave the same way as ssh.
2921 * --fifo now works in csh, too.
2923 * Q(...) can be used in {= =} to shell quote a string.
2925 * GNU Parallel was cited in: DockBench: An Integrated Informatic
2926 Platform Bridging the Gap between the Robust Validation of Docking
2927 Protocols and Virtual Screening Simulations
2928 http://www.mdpi.com/1420-3049/20/6/9977
2930 * GNU Parallel was cited in: Swedes Online: You Are More Tracked Than
2932 http://www.diva-portal.org/smash/get/diva2:807623/FULLTEXT01.pdf
2934 * GNU Parallel was cited in: Tutorial: Lorenz-Mie theory for 2D
2935 scattering and resonance calculations
2936 http://arxiv.org/pdf/1505.07691.pdf
2938 * GNU Parallel was cited in: A quantitative assessment of the Hadoop
2939 framework for analyzing massively parallel DNA sequencing data
2940 http://link.springer.com/article/10.1186/s13742-015-0058-5
2942 * GNU Parallel was cited in: A composite genome approach to identify
2943 phylogenetically informative data from next-generation sequencing
2944 http://www.biomedcentral.com/content/pdf/s12859-015-0632-y.pdf
2946 * GNU Parallel is used in: taxator-tk
2947 http://algbio.cs.uni-duesseldorf.de/webapps/wa-download/
2949 * GNU Parallel is used in: https://github.com/d2207197/local-mapreduce
2951 * GNU Parallel is used in: wiki-edit-news https://github.com/albert-decatur/wiki-edit-news
2953 * GNU Parallel is used in: A Fingerprint Identification System
2954 https://curve.carleton.ca/system/files/theses/28733.pdf
2956 * Job ad asking for GNU Parallel experience:
2957 http://searchjobs.intel.com/gdansk-pol/software-validation-engineer/63A06826DAF24797AB414DC146201C2E/job/
2959 * Using BLAT http://wangzhengyuan.blogspot.dk/2015/06/using-blat.html
2961 * Bug fixes and man page updates.
2966 * Security: The security issue for --sshlogin + --fifo/--cat has been
2967 fixed. Thereby all issues with
2968 http://lists.gnu.org/archive/html/parallel/2015-04/msg00045.html
2971 * Security: After further security analysis the issue fixed in
2972 20150422 also fixed the problem for --tmux.
2974 * GNU Parallel was cited in: CIDER: a pipeline for detecting waves of
2975 coordinated transcriptional regulation in gene expression
2977 http://biorxiv.org/content/biorxiv/early/2015/03/17/012518.full.pdf
2979 * GNU Parallel was cited in: Building Genomic Analysis Pipelines in a
2980 Hackathon Setting with Bioinformatician Teams: DNA-seq, Epigenomics,
2981 Metagenomics and RNA-seq
2982 http://biorxiv.org/content/biorxiv/early/2015/05/05/018085.full.pdf
2984 * GNU Parallel was cited in: Sequencing the cap-snatching repertoire
2985 of H1N1 influenza provides insight into the mechanism of viral
2986 transcription initiation
2987 http://nar.oxfordjournals.org/content/early/2015/04/20/nar.gkv333.full.pdf
2989 * GNU Parallel was cited in: Genome assembly using Nanopore-guided
2990 long and error-free DNA reads
2991 http://www.biomedcentral.com/content/pdf/s12864-015-1519-z.pdf
2993 * GNU Parallel was used (unfortunately with wrong citation) in:
2994 Comparing the CarbonTracker and TM5-4DVar data assimilation systems
2995 for CO2 surface flux inversions
2996 http://www.atmos-chem-phys-discuss.net/15/8883/2015/acpd-15-8883-2015-discussion.html
2998 * GNU Parallel was used in: Gene Set Omic Analysis (GSOA) method
2999 https://bitbucket.org/srp33/gsoa
3001 * A Quick and Neat :) Orchestrator using GNU Parallel
3002 http://www.elsotanillo.net/2015/05/a-quick-and-neat-orchestrator-using-gnu-parallel/
3004 * Execute commands on multiple computers using GNU Parallel (setting
3005 up a cluster on the cheap)
3006 https://spectraldifferences.wordpress.com/2015/04/26/execute-commands-on-multiple-computers-using-gnu-parallel-setting-up-a-cluster-on-the-cheap/
3008 * Functions and GNU parallel for effective cluster load management
3009 http://genomespot.blogspot.dk/2015/04/functions-and-gnu-parallel-for.html
3011 * Use parallel processing to save time importing databases
3012 http://drupalsun.com/node/41854
3014 * Run multiple ssh commands in parallel with GNU Parallel
3015 http://www.ameir.net/blog/archives/380-run-multiple-ssh-commands-in-parallel-with-gnu-parallel.html
3017 * Importing huge databases faster
3018 https://www.lullabot.com/blog/article/importing-huge-databases-faster
3020 * Parallel? Gnu parallel! https://debian.pro/1834
3022 * Bug fixes and man page updates.
3027 New in this release:
3029 * Security fix. An attacker on the local system could make you
3030 overwrite one of your own files with a single byte. The problem
3031 exist when you use --compress or --tmux or --pipe or --cat or
3032 --fifo. The attacker must figure out the randomly chosen file name
3033 and create a symlink within a time window of 15 ms.
3035 * --shuf will generate all jobs, and shuffle them before running
3036 them. This is useful to get a quick preview of the results before
3037 running the full batch.
3039 * GNU Parallel now has a DOI: https://dx.doi.org/10.5281/zenodo.16303
3041 * GNU Parallel was cited in: Scaling Machine Learning for Target
3042 Prediction in Drug Discovery using Apache Spark
3043 https://cris.cumulus.vub.ac.be/portal/files/5147244/spark.pdf
3045 * GNU Parallel was cited in: Bayesian inference of protein structure
3046 from chemical shift data https://peerj.com/articles/861/
3048 * GNU Parallel was cited in: Toward Enhanced Metadata Quality of
3049 Large-Scale Digital Libraries: Estimating Volume Time Range
3050 https://www.ideals.illinois.edu/bitstream/handle/2142/73656/186_ready.pdf
3052 * GNU Parallel was cited in: Experimental study on the Wind Farm
3053 Substation Cable Installation Problem
3054 http://i11www.iti.uni-karlsruhe.de/_media/teaching/theses/ma-schmitz-14.pdf
3056 * GNU Parallel was used in: https://github.com/KAPPS-/landsat-gifworks
3058 * GNU Parallel was used in: https://github.com/exascience/elprep
3060 * GNU Parallel was used in:
3061 http://search.cpan.org/~jillrowe/HPC-Runner-GnuParallel-0.01/
3063 * GNU Parallel was used in:
3064 http://search.cpan.org/~ajpage/Bio-Roary-2.0.7/lib/Bio/Roary/JobRunner/Parallel.pm
3066 * GNU Parallel was used in: Rapid haploid SNP calling
3067 https://github.com/tseemann/snippy
3069 * Pictures and Metadata
3070 http://www.ozzy.no/2015/02/05/pictures-and-metadata/
3072 * Task automation with bash and parallel
3073 https://biowize.wordpress.com/2015/03/23/task-automation-with-bash-and-parallel/
3075 * How To: Speed Up File Transfers in Linux using RSync with GNU
3077 http://www.yourownlinux.com/2015/04/speed-up-file-transfers-using-rsync-with-gnu-parallel.html
3079 * Mirroring a Git Repository
3080 https://avacariu.me/articles/mirroring-a-git-repository.html
3082 * Add an ENVI header to JAXA Global Mangrove Watch PALSAR tiles
3083 https://spectraldifferences.wordpress.com/2015/03/24/add-an-envi-header-to-jaxa-global-mangrove-watch-palsar-tiles/
3086 http://www.zhihu.com/question/29257300
3088 * Bug fixes and man page updates.
3093 New in this release:
3095 * --number-of-cores respects 'taskset' on GNU/Linux.
3097 * --joblog --pipe gives the data send and received in the log.
3099 * GNU Parallel was tested to support 100 GB sized records in --pipe. A
3100 few bugs was fixed to support >2 GB records. It works, but is rather
3103 * GNU Parallel was cited in: RIG: Recalibration and Interrelation of
3104 genomic sequence data with the GATK
3105 http://www.g3journal.org/content/early/2015/02/13/g3.115.017012.full.pdf+html
3107 * GNU Parallel was cited in: MPI-blastn and NCBI-TaxCollector:
3108 Improving metagenomic analysis with high performance classification
3109 and wide taxonomic attachment
3110 http://www.worldscientific.com/doi/abs/10.1142/S0219720014500139?af=R&
3112 * GNU Parallel was cited in: Recent evolution in Rattus norvegicus is
3113 shaped by declining effective population size
3114 http://biorxiv.org/content/biorxiv/early/2015/03/01/015818.full.pdf
3116 * GNU Parallel was cited in: Evidence for DCO+ as a probe of
3117 ionization in the warm disk surface
3118 http://arxiv.org/pdf/1503.02659.pdf
3120 * GNU Parallel was cited in: De novo assembly and annotation of the
3121 Asian tiger mosquito (Aedes albopictus) repeatome with dnaPipeTE
3122 from raw genomic reads and comparative analysis with the yellow
3123 fever mosquito (Aedes aegypti)
3124 http://gbe.oxfordjournals.org/content/early/2015/03/11/gbe.evv050.full.pdf
3126 * GNU Parallel was cited in: A General Approach to Network
3127 Configuration Analysis
3128 http://research.microsoft.com/en-us/um/people/ratul/papers/nsdi2015-batfish.pdf
3130 * GNU Parallel was cited in: Scrimer: designing primers from
3132 http://onlinelibrary.wiley.com/doi/10.1111/1755-0998.12403/pdf
3134 * GNU Parallel was cited in: Efficient Retrieval of Key Material for
3135 Inspecting Potentially Malicious Traffic in the Cloud
3136 http://sacko.uk/pdf/2015.1.pdf
3138 * GNU Parallel will be presented at Strataconf: Poor Man's Parallel
3140 http://strataconf.com/big-data-conference-uk-2015/public/schedule/detail/40031
3142 * GNU Parallel was used in:
3143 https://github.com/alexbyrnes/FCC-Political-Ads_The-Code
3145 * GNU Parallel was used in: https://github.com/martymac/fpart
3147 * GNU Parallel was used in:
3148 https://github.com/hoytak/diabetic-retinopathy-code
3150 * GNU Parallel was used in:
3151 https://github.com/mehmattski/HybSeqPipeline
3153 * GNU Parallel was used in:
3154 http://search.cpan.org/~ajpage/Bio-Roary-2.0.0/lib/Bio/Roary/JobRunner/Parallel.pm
3156 * Using GNU Parallel on a Raspberry Pi cluster:
3157 http://www.dcglug.org.uk/cluster-progress/
3159 * An introduction to vector tiling and map reduce in postgis:
3160 http://dimensionaledge.com/intro-vector-tiling-map-reduce-postgis/
3162 * Running scripts in parallel with GNU Parallel:
3163 http://code.jasonbhill.com/2015/03/
3165 * Mahout: Parallelising the creation of DecisionTrees:
3166 http://www.markhneedham.com/blog/2012/12/27/mahout-parallelising-the-creation-of-decisiontrees/
3168 * High-Performance Scientific Computing: Running serial jobs in
3170 https://support.scinet.utoronto.ca/education/staticpublic/course178/serial.pdf
3172 * Parallel cardinality on your laptop
3173 https://highonscience.wordpress.com/2015/03/15/parallel-cardinality-on-your-laptop/
3175 * Experiments about a better locate using grep
3176 http://a3nm.net/blog/better_locate.html
3178 * Homework with GNU Parallel:
3179 https://support.scinet.utoronto.ca/education/staticpublic/course178content349.html
3181 * Parallel - Jobs in Skripten parallelisieren:
3182 https://slzm.de/blog/linux-tool-des-tages-parallel-jobs-in-skripten-parallelisieren/#more-612
3184 * GNU Parallel, czyli 100% użycia procesora
3185 http://matmatyk.blogspot.dk/2015/03/gnu-parallel-czyli-100-uzycia-procesora.html
3187 * Bug fixes and man page updates.
3192 * --tmux has gotten a major overhaul.
3194 * GNU Parallel was cited in: RaftLib: A C++ Template Library for High
3195 Performance Stream Parallel Processing
3196 http://www.cs.wustl.edu/~lip/pubs/pmam15_jbeard.pdf
3198 * GNU Parallel was cited in: Quantifying properties of hot and dense
3199 QCD matter through systematic model-to-data comparison
3200 http://arxiv.org/pdf/1502.00339.pdf
3202 * GNU Parallel was cited in: Towards Collaborative Exploration and
3203 Analysis of Big Data from Mars: A Noachis Terra Case Study
3204 http://link.springer.com/chapter/10.1007/978-3-319-13865-7_25
3206 * GNU Parallel was used (unfortunately with wrong citation) in:
3207 Performance and Scaling Comparison Study of RDBMS and NoSQL
3209 http://ijact.in/wp-content/uploads/2014/11/COMPUSOFT-311-1270-1275.pdf
3211 * GNU Parallel was used (unfortunately without citation) in: Parallel
3212 Implementation of Big Data Pre-Processing Algorithms for Sentiment
3213 Analysis of Social Networking Data
3214 http://www.researchmathsci.org/IJFMAart/ijfma-v6n2-7.pdf
3216 * GNU Parallel was used (unfortunately without citation) in: SpeedSeq:
3217 Ultra-fast personal genome analysis and interpretation
3218 http://biorxiv.org/content/biorxiv/early/2014/12/05/012179.full.pdf
3220 * Zip Folders with GNU Parallel
3221 http://fazky.github.io/posts/Linux/2015-01-07-GNU-Parallel.html
3223 * Using GNU Parallel with Freesurfer
3224 http://programminginadarkroom.blogspot.dk/2015/02/using-gnu-parallel-with-freesurfer.html
3226 * GNU Parallel is used in Velociraptor: https://github.com/ericwhyne/Velociraptor
3228 * Marcus Beach GNU Parallel http://marcusbeach.co/gnu-parallel/
3230 * Bug fixes and man page updates.
3235 * Remote jobs now send stderr (standard error) to stderr (standard
3236 error) instead of stdout (standard output).
3238 * Remote execution command is now packed using base64 encoded
3239 bzip2. This means that big environments (app. 100 KB) can be
3240 transferred. This change makes remote execution alpha quality.
3242 * --semaphoretimeout now takes a negative value. This means give up if
3243 the semaphore is not gotten within the timeout.
3245 * --halt -1 and -2 now means halt if a job succeeds (so the opposite
3248 * --no-keep-order will reverse --keep-order.
3250 * Bash's second fix of shellshock caused --env to break again when
3251 exporting functions. This has been fixed again.
3253 * A semibig refactoring of big functions. All non-trivial functions
3254 are now less than 100 lines. The refactoring makes this release beta
3257 * A description of the design decisions for GNU Parallel can be found
3258 in 'man parallel_design'.
3260 * A bug fix in replacement strings caused rewrite of the replacement
3261 function. This makes use of replacement strings alpha quality.
3263 * GNU Parallel was cited in: Improving Energy and Performance with
3264 Spintronics Caches in Multicore Systems
3265 http://link.springer.com/chapter/10.1007/978-3-319-14313-2_24
3267 * GNU Parallel was cited in: Parallel post-processing with MPI-Bash
3268 http://dl.acm.org/citation.cfm?id=2691137
3270 * GNU Parallel was cited in: Distinguishing cause from effect using
3271 observational data: methods and benchmarks
3272 http://arxiv-web3.library.cornell.edu/pdf/1412.3773.pdf
3274 * GNU Parallel was cited in: Data Science at the Command Line
3275 http://cdn.oreillystatic.com/oreilly/booksamplers/9781491947852_sampler.pdf
3277 * GNU Parallel was cited in: Resolution of Genetic Map Expansion
3278 Caused by Excess Heterozygosity in Plant Recombinant Inbred
3279 Populations http://www.g3journal.org/content/4/10/1963.full.pdf
3281 * GNU Parallel was cited in: Bayesian Inference of Protein Structure
3282 from Chemical Shift Data https://peerj.com/preprints/692v1.pdf
3284 * GNU Parallel was cited in: Clonal interference and Mullerʼs ratchet
3285 in spatial habitats http://iopscience.iop.org/1478-3975/11/5/056003
3287 * GNU Parallel was cited in: Computação Verde na Camada de Aplicação
3288 https://linux.ime.usp.br/~tpaiva/mac0499/files/monografia.pdf
3290 * GNU Parallel was cited in: Frameshift alignment: statistics and
3291 post-genomic applications
3292 http://bioinformatics.oxfordjournals.org/content/30/24/3575.full.pdf+html
3294 * GNU Parallel was cited in: Towards Recommender Engineering Tools and
3295 Experiments for Identifying Recommender Differences
3296 http://elehack.net/research/thesis/mde-thesis.pdf
3298 * GNU Parallel was cited in: Speaker Environment Classification Using
3299 Rhythm Metrics in Levantine Arabic Dialect
3300 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6923918
3302 * GNU Parallel was cited in: A Formal Proof Of The Kepler Conjecture
3303 http://arxiv.org/pdf/1501.02155.pdf
3305 * GNU Parallel was cited in: Allocation Policy Analysis for Cache
3306 Coherence Protocols for STT-MRAM-based caches
3307 http://conservancy.umn.edu/bitstream/handle/11299/169362/Nandkar_umn_0130M_15551.pdf
3309 * GNU Parallel was cited in: Using Trusted Platform Module for
3310 securing virtual environment access in Cloud
3311 http://dar.aucegypt.edu:8080/bitstream/handle/10526/4237/Using%20Trusted%20Platform%20Module%20for%20Securing%20Virtual%20Environment%20Access%20in%20Cloud.pdf
3313 * GNU Parallel was cited in: Weakly Supervised Learning for
3314 Compositional Sentiment Recognition
3315 http://computerlinguist.org/static/downloads/ma-thesis/Master_Thesis-Michael_Haas-Weakly_Supervised_Learning_for_Compositional_Sentiment_Recognition.pdf
3317 * GNU Parallel was cited in: Agility and Performance in Elastic
3318 Distributed Storage http://dl.acm.org/citation.cfm?id=2668129
3320 * GNU Parallel was used (unfortunately without citation) in: Large
3321 Scale Author Name Disambiguation in Digital Libraries
3322 http://semanticommunity.info/@api/deki/files/31523/P227_3546.pdf
3324 * GNU Parallel is used in BEDOPS:
3325 https://media.readthedocs.org/pdf/bedops/v2p5p0/bedops.pdf
3327 * Job ad asking for GNU Parallel skills:
3328 http://www.aplitrak.com/?adid=dXMzMTYxMjQuMzg0MTkuMTU1MEBtYW5wb3dlcmZveG5hLmFwbGl0cmFrLmNvbQ#sthash.kYCIhhty.KcoT6HnJ.dpbs
3330 * GNU Parallel: Open Source For You (OSFY) magazine, October 2013
3332 http://www.shakthimaan.com/posts/2014/11/27/gnu-parallel/news.html
3334 * Multithreaded Encryption and Compression
3335 http://www.krazyworks.com/multithreaded-encryption-and-compression/
3337 * GNU Parallel on OSX and Linux
3338 https://darknightelf.wordpress.com/2015/01/01/gnu-parallel-on-osx/
3340 * How to build gnu parallel from source on Ubuntu PC?
3341 http://blog.ovidiuparvu.com/build-gnu-parallel-source-ubuntu-pc/
3343 * GNU parallel for openaddr-process-one
3344 https://nelsonslog.wordpress.com/2015/01/09/gnu-parallel-for-openaddr-process-one/
3346 * From SRA Project to FastQ http://danielecook.com/sra-project-fastq/
3348 * Software Development Tooling
3349 http://www.computer.org/csdl/mags/so/2014/06/mso2014060021.pdf
3351 * コマンドを並列に実行するGNU parallelがとても便利
3352 http://bicycle1885.hatenablog.com/entry/2014/08/10/143612
3354 * Bug fixes and man page updates.
3359 * Remote systems can be divided into hostgroups (e.g. web and db) by
3360 prepending '@groupname/' to the sshlogin. Multiple groups can be
3361 given by separating groups with '+'. E.g. @web/www1 @web+db/www2
3364 * Remote execution can be restricted to servers that are part of one
3365 or more groups by '@groupname' as an sshlogin. Multiple groups can
3366 be given by separating groups with '+'. E.g. -S @web or -S @db+web
3368 * With --hostgroup you can restrict arguments to certain hostgroups by
3369 appending '@groupname' to the argument. Multiple groups can be
3370 given by separating groups with '+'. E.g. my_web_arg@web
3371 db-or-web-arg@db+web db-only-arg@db Thanks to Michel Courtine for
3372 developing a prototype for this.
3374 * GNU Parallel was cited in: HTSeq-Hadoop: Extending HTSeq for
3375 Massively Parallel Sequencing Data Analysis using Hadoop
3376 http://essenceofescience.se/wp-content/uploads/2014/11/Siretskiy.pdf
3378 * GNU Parallel was cited in: SlideToolkit: An Assistive Toolset for
3379 the Histological Quantification of Whole Slide Images
3380 http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0110289
3382 * GNU Parallel was cited in: Exploring a multiprocessor design space
3383 to analyze the impact of using STT-RAM in the memory hierarchy
3384 http://conservancy.umn.edu/bitstream/handle/11299/167286/Borse_umn_0130M_15431.pdf
3386 * Command-Line OCR with Tesseract on Mac OS X
3387 https://ryanfb.github.io/etc/2014/11/13/command_line_ocr_on_mac_os_x.html
3389 * Bug fixes and man page updates.
3394 * --env was changed to deal with Bash's new way of exporting a function.
3396 * GNU Parallel was cited in: Exclusion of cosmic rays in
3397 protoplanetary disks. II. Chemical gradients and observational
3398 signatures http://iopscience.iop.org/0004-637X/794/2/123/article
3400 * GNU Parallel was cited in: Application of Machine Learning to
3401 Algorithm Selection for TSP
3402 http://www.dbai.tuwien.ac.at/staff/musliu/art_ictai_cam.pdf
3404 * GNU Parallel was cited in: Performance Models for LTE-Advanced
3406 http://repository.asu.edu/attachments/137242/content/Tyagi_asu_0010E_14116.pdf
3408 * GNU Parallel was used (unfortunately without citation) in: De Novo
3409 Insertions and Deletions of Predominantly Paternal Origin Are
3410 Associated with Autism Spectrum Disorder
3411 http://www.cell.com/cms/attachment/2019079667/2039310868/mmc1.pdf
3413 * GNU Parallel was determined 'popular' by Statistical Analysis of
3414 Popular Open Source Software Projects and Their Communities
3415 http://andiwre.itmaranatha.org/prosiding/ICITEE2014/PaperAndiWRE-ICITEE2014.pdf
3417 * GNU Parallel is demonstrated in: Data Science at the Command Line:
3418 Facing the Future with Time-Tested Tools
3420 * GNU Parallel was covered in a talk at Sydney Perl Mongers group
3421 http://www.openfusion.net/talks/pwp/#24
3423 * GNU Parallel and how to get started with it
3424 http://www.jduck.net/blog/2014/09/30/gnu-paralell/
3426 * Behat/Selenium/Parallel
3427 http://jaffamonkey.com/behat-selenium-parallel/
3429 * Comparing Golang, Scala, Elixir and Ruby for ETL
3430 http://www.dimroc.com/2014/09/29/etl-language-showdown/
3432 * Assemble a list of which of these hosts are up or down
3433 http://opsfun.wordpress.com/2014/03/31/gnu-parallel/
3435 * Running commands on many nodes simultaneously
3436 http://opsfun.wordpress.com/2014/03/31/19/
3438 * Ubuntu 13.04でGNU ParallelをGNUモードで動かす
3439 http://qiita.com/YusukeSuzuki@github/items/7b96b5876bf980f21e85
3441 * Bug fixes and man page updates.
3446 * If the file given as --sshloginfile is changed it will be re-read
3447 when a job finishes though at most once per second. This makes it
3448 possible to add and remove hosts while running.
3450 * Brutha uses GNU Parallel https://pypi.python.org/pypi/brutha/1.0.2
3452 * OCRmyPDF uses GNU Parallel https://github.com/fritz-hh/OCRmyPDF/
3454 * GNU Parallel was presented at Balti and Bioinformatics "On-Air"
3455 http://youtu.be/UtXlr19xTh8?t=2h5m0s
3457 * Pleiades Plus uses GNU Parallel
3458 https://github.com/ryanfb/pleiades-plus
3460 * Imagemagick and GNU Parallel
3461 http://deepdish.io/2014/09/15/gnu-parallel/
3463 * GNU Parallel (Sebuah Uji Coba)
3464 http://pr4ka5a.wordpress.com/2014/09/04/gnu-parallel-sebuah-uji-coba/
3466 * GNU Parallel: 并行执行Linux命令
3467 http://blog.csdn.net/xzz_hust/article/details/39183837
3472 * GNU Parallel now uses the same shell it was started from as the
3473 command shell for local jobs. So if GNU Parallel is started from
3474 tcsh it will use tcsh as its shell even if the login $SHELL is
3475 different. For remote jobs the login $SHELL will be used.
3477 * The whole current environment in bash can be copied by using a shell
3478 wrapper function (Search manual for env_parallel).
3480 * --plus adds the replacement strings {+/} {+.} {+..} {+...} {..}
3481 {...} {/..} {/...}. The idea being that '+foo' matches the opposite
3482 of 'foo' and {} = {+/}/{/} = {.}.{+.} = {+/}/{/.}.{+.} = {..}.{+..}
3483 = {+/}/{/..}.{+..} = {...}.{+...} = {+/}/{/...}.{+...}
3485 * GNU Parallel now deals correctly with the combination
3486 rsync-3.1.X-client and rsync-2.5.7-server
3488 * GNU Parallel was cited in: A Web Service for Scholarly Big Data
3489 Information Extraction
3490 http://patshih.ist.psu.edu/publications/Williams-CiteSeerExtractor-ICWS14.pdf
3492 * Comparison of the speed of different GNU Parallel versions:
3493 http://lists.gnu.org/archive/html/parallel/2014-08/msg00030.html
3495 * GNU Parallel was covered in the webcast 2014-08-20: Data Science at
3496 the Command Line http://www.oreilly.com/pub/e/3115
3498 * Distributed processing with GNU parallel
3499 http://kazjote.eu/2014/08/11/distributed-processing-with-gnu-parallel
3501 * A Peek into GNU Parallel
3502 http://blog.dataweave.in/post/94238943763/a-peek-into-gnu-parallel
3504 * Сборка GNU parallel для CentOS/RHEL
3505 http://www.stableit.ru/2014/07/gnu-parallel-centosrhel.html
3507 * Bug fixes and man page updates.
3512 * {= perl expression =} can be used as replacement string. The
3513 expression should modify $_. E.g. {= s/\.gz$// =} to remove .gz from
3514 the string. This makes replacement strings extremely flexible.
3516 * Positional perl expressions (similar to {2}) are given as {=2 perl
3517 expression=} where 2 is the position.
3519 * One small backwards incompatibility: {1}_{2} will replace {2} with
3520 the empty string if there is only one argument. Previously {2} would
3521 have been left untouched.
3523 * Replacement strings can be defined using --rpl. E.g. parallel --rpl
3524 '{.gz} s/\.gz$//' echo {.gz} ::: *.gz
3526 * The parenthesis around {= perl expression =} can be changed with
3529 * --tmux will direct the output to a tmux session instead of
3530 files. Each running jobs will be in its own window.
3532 * --halt 10% will stop spawning new jobs if 10% failed so far.
3534 * GNU Parallel was cited in: bammds: A tool for assessing the ancestry
3535 of low depth whole genome data using multidimensional scaling (MDS)
3536 http://bioinformatics.oxfordjournals.org/content/early/2014/06/28/bioinformatics.btu410.abstract
3538 * GNU Parallel was cited in: Molecular ferroelectric contributions to
3539 anomalous hysteresis in hybrid perovskite solar cells
3540 http://people.bath.ac.uk/aw558/publications/2014/arxiv_hysteresis_14.pdf
3542 * GNU Parallel was cited in: Energy Sorghum-a genetic model for the
3543 design of C4 grass bioenergy crops
3544 http://jxb.oxfordjournals.org/content/early/2014/06/20/jxb.eru229.short
3546 * GNU Parallel was cited in: Web-scale Content Reuse Detection
3547 www.isi.edu/~johnh/PAPERS/Ardi14a.pdf
3549 * Tell your friends to sign up for the Webcast at 2014-08-20 covering
3550 GNU Parallel: Data Science at the Command Line
3551 http://www.oreilly.com/pub/e/3115
3553 * GNU Parallel all the things!
3554 http://longwayaround.org.uk/notes/gnu-parallel-all-the-things/
3556 * Shell command composition and dispatch
3557 http://lukeluo.blogspot.dk/2014/07/linux-virtual-console6-shell-command.html
3559 * Parallelising plink (or anything else) the easy way
3560 http://chrisladroue.com/2012/03/parallelising-plink-or-anything-else-the-easy-way/
3562 * Easy and cheap cluster building on AWS
3563 https://grapeot.me/easy-and-cheap-cluster-building-on-aws.html
3565 * Paralelizace běžných činností v konzoli pomocí GNU Parallel
3566 http://www.abclinuxu.cz/clanky/paralelizace-beznych-cinnosti-v-konzoli-pomoci-gnu-parallel
3568 * [原] Ubuntu 下使用 parallel 命令的注意事项
3569 http://blog.ailms.me/2014/06/28/ubuntu-with-parallel.html
3571 * 简单的并行, 可使用GNU parallel
3572 http://jerkwin.github.io/2014/06/10/GNU-parallel/
3574 * Bug fixes and man page updates.
3579 * --shebang and --shebang-wrap now works on FreeBSD.
3581 * --pipepart works with --header, --regexp, --cat and --fifo.
3583 * ./configure --disable-documentation will not build documentation.
3585 * {%} works as job slot.
3587 * GNU Parallel was cited in: Energy Efficient, High-speed
3588 Communication in WSNs
3589 https://gupea.ub.gu.se/bitstream/2077/35801/1/gupea_2077_35801_1.pdf
3591 * GNU Parallel was cited in: Ferroelectric contributions to anomalous
3592 hysteresis in hybrid perovskite solar cells
3593 http://arxiv.org/pdf/1405.5810.pdf
3595 * Processes Paralleling to Speed up Computing and Tasks Execution in
3597 http://kukuruku.co/hub/nix/processes-paralleling-to-speed-up-computing-and-tasks-execution-in-linux
3599 * Moving / Copying lots of s3 files quickly using gnu parallel
3600 http://blog.aclarke.eu/moving-copying-lots-of-s3-files-quickly-using-gnu-parallel/
3602 * Speeding up grep log queries with GNU Parallel
3603 http://www.tripwire.com/state-of-security/incident-detection/speeding-grep-queries-gnu-parallel/
3605 * Ubuntu - Gnu parallel - It's awesome
3606 http://kasunweranga.blogspot.dk/2014/06/ubuntu-gnu-parallel-its-awesome.html
3608 * Export quicklooks with vector overlay using TuiView
3609 http://spectraldifferences.wordpress.com/2014/03/08/export-quicklooks-with-vector-overlay-using-tuiview/
3611 * GNU Parallel指南 http://my.oschina.net/enyo/blog/271612
3613 * GNU parallelで違和感 http://jarp.does.notwork.org/diary/201405c.html#201405301
3615 * Bug fixes and man page updates.
3620 * Use --semaphoretimeout to ignore the semaphore lock after a while.
3622 * {%} introduced as job slot replacement string. It has known bugs.
3624 * --slotreplace changes slot replacement string.
3626 * GNU Parallel officially in Solaris 11.2beta
3627 https://blogs.oracle.com/alanc/entry/solaris_11_2_changes_to
3629 * GNU Parallel was cited in: A Comparison of Antenna Placement
3630 Algorithms http://abhinavjauhri.com/publications/eap.pdf
3632 * Using GNU Parallel on a PBS cluster (nice use of --shebang-wrap)
3633 https://docs.it4i.cz/anselm-cluster-documentation/resource-allocation-and-job-execution/capacity-computing
3635 * BioLite uses GNU Parallel: https://bitbucket.org/caseywdunn/biolite
3637 * Isitdown uses GNU Parallel: http://www.isi.edu/~calvin/isitdown.md
3639 * Convert FLAC to MP3 with GNU parallel
3640 http://www.blogobramje.nl/posts/Convert_FLAC_to_MP3_with_GNU_parallel/
3642 * JD Edwards Business Function Documentation
3643 http://www.azertech.net/content/jd-edwards-business-function-documentation
3645 * Tools of the trade http://blog.eikeland.se/2014/05/01/tools-of-the-trade/
3647 * How I start a bioinformatics project
3648 http://nickloman.github.io/2014/05/14/how-i-start-a-bioinformatics-project/
3650 * No:The-Me GNU Parallel http://adityalaghate.in/gnu-parallel.html
3652 * Bug fixes and man page updates.
3657 * --pipepart is a highly efficient alternative to --pipe if the input
3658 is a real file and not a pipe.
3660 * If using --cat or --fifo with --pipe the {} in the command will be
3661 replaced with the name of a physical file and a fifo respectively
3662 containing the block from --pipe. Useful for commands that cannot
3663 read from standard input (stdin).
3665 * --controlmaster has gotten an overhaul and is no longer
3668 * --env is now copied when determining CPUs on remote system. Useful
3669 for copying $PATH if parallel is not in the normal path.
3671 * --results now chops the argument if the argument is longer than the
3672 allowed path length.
3674 * Build now survives if pod2* are not installed.
3676 * The git repository now contains tags of releases.
3678 * GNU Parallel was cited in: Proactive System for Digital Forensic
3680 http://dspace.library.uvic.ca:8080/bitstream/handle/1828/5237/Alharbi_Soltan_PhD_2014.pdf
3682 * GNU Parallel was cited in: Beyond MAP estimation with the
3683 track-oriented multiple hypothesis tracker
3684 http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=6766651&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D6766651
3686 * GNU Parallel was cited in: Prokka: rapid prokaryotic genome
3688 http://bioinformatics.oxfordjournals.org/content/early/2014/03/18/bioinformatics.btu153.short
3690 * GNU Parallel was used (unfortunately with improper citation) in:
3691 Perspectives in magnetic resonance: NMR in the post-FFT era
3692 http://www.sciencedirect.com/science/article/pii/S1090780713003054
3694 * GNU Parallel is used in https://github.com/cc2qe/speedseq
3696 * Batch XML validation at the command line.
3697 http://horothesia.blogspot.dk/2014/04/batch-xml-validation-at-command-line.html
3699 * freebayes-parallel uses GNU Parallel
3700 https://github.com/ekg/freebayes/commit/31ee997984cebe8a196381c3de57e618e34a2281
3702 * Org-mode with Parallel Babel http://draketo.de/english/emacs/parallel-babel#sec-2
3704 * Speeding Up Grep Log Queries with GNU Parallel
3705 http://www.cybersecurity.io/speeding-grep-queries-gnu-parallel/
3707 * How to run tbss_2_reg in parallel
3708 http://tadpolebrainimaging.blogspot.dk/2014/03/how-to-run-tbss2reg-in-parallel.html
3710 * GNU parallel example: blastn https://asciinema.org/a/8775
3712 * Iterative DNS Brute Forcing
3713 http://www.room362.com/blog/2014/02/19/iterative-dns-brute-forcing/
3715 * Ejecutando comandos en paralelo
3716 http://jesusmercado.com/guias/ejecutando-comandos-en-paralelo/
3718 * Ejecutando en paralelo en bash (ejemplo con rsync)
3719 http://eithel-inside.blogspot.dk/2014/04/ejecutando-en-paralelo-en-bash-ejemplo.html
3721 * Bug fixes and man page updates.
3726 * Offical package for Alpine Linux now exists:
3727 http://alpinelinux.org/apk/main/x86/parallel
3729 * GNU Parallel was cited in: Estimating uncertainties in statistics
3730 computed from direct numerical simulation
3731 http://dx.doi.org/10.1063/1.4866813
3733 * GNU Parallel was cited in: Vehicle routing problems with time
3734 windows and multiple service workers: a systematic comparison
3735 between ACO and GRASP
3736 http://link.springer.com/article/10.1007/s10100-014-0341-z
3738 * GNU Parallel, quick and easy
3739 http://www.reganmian.net/blog/2014/03/09/gnu-parallel-quick-and-easy/
3741 * Using Multiple CPU Cores With Command Line Tools
3742 http://prateekvjoshi.com/2014/03/07/using-multiple-cpu-cores-with-command-line-tools/
3744 * Batch convert mp3 CBR to VBR
3745 http://blogs.zercle.com/bouroo/2013/03/batch-convert-mp3-cbr-to-vbr/
3747 * Running Behat in parallel with Selenium grid
3748 http://zalas.eu/running-behat-in-parallel-with-selenium-grid/
3750 * Git-Mirror per cronjob aktuell halten
3751 https://www.schtobia.de/2013/git-mirror-per-cronjob-aktuell-halten/
3753 * Пишем многопоточный скрипт на bash
3754 http://dafter.ru/duf/howto/130.html
3756 * 如何利用多核CPU来加速你的Linux命令
3757 http://www.chinadmd.com/file/xpcr6wpctzwtuu3ivwiaatcs_1.html
3759 * Bug fixes and man page updates.
3764 * --tollef has been retired.
3766 * --compress has be redesigned due to bugs.
3768 * Format of --eta and --joblog has changed slightly.
3770 * GNU Parallel was cited in: Speaker Verification and Keyword Spotting
3771 Systems for Forensic Applications
3772 http://lantana.tenet.res.in/website_files/thesis/Phd/srikanth.pdf
3774 * GNU Parallel was cited in: Scaleable Code Clone Detection
3775 http://scg.unibe.ch/archive/phd/schwarz-phd.pdf
3777 * GNU Parallel was cited in: Clone Detection that scales
3778 http://scg.unibe.ch/archive/masters/Vogt14a.pdf
3780 * GNU Parallel was cited in: Scalable Positional Analysis for Studying
3781 Evolution of Nodes in Networks
3782 http://arxiv-web3.library.cornell.edu/pdf/1402.3797
3784 * GNU Parallel was cited in: Aggregate Characterization of User
3785 Behavior in Twitter and Analysis of the Retweet Graph
3786 http://arxiv.org/pdf/1402.2671v1
3788 * GNU Parallel was used (unfortunately without citation) in: Causal
3789 Network Models for Predicting Compound Targets and Driving Pathways
3791 http://jbx.sagepub.com/content/early/2014/02/10/1087057114522690.full
3793 * GNU Parallel was used (unfortunately without citation) in:
3794 Performance and Energy Efficiency of Common Compression /
3795 Decompression Utilities
3796 http://www.researchgate.net/publication/243962643_Performance_and_Energy_Efficiency_of_Common_CompressionDecompression_Utilities_An_Experimental_Study_in_Mobile_and_Workstation_Computer_Platforms/file/3deec51d1dbc0474f9.pdf
3798 * GNU Parallel was used (unfortunately without citation) in: SpringFS:
3799 Bridging Agility and Performance in Elastic Distributed Storage
3800 http://www.istc-cc.cmu.edu/publications/papers/2014/SpringFS-FAST14.pdf
3802 * GNU Parallel was recommended (without citation) in: Redesigning the
3803 Specificity of Protein-DNA Interactions with Rosetta
3804 http://link.springer.com/protocol/10.1007/978-1-62703-968-0_17
3806 * GNU Parallel is co-distributed with RepeatExplorer
3807 http://www.vcru.wisc.edu/simonlab/bioinformatics/programs/repeatexplorer/README.txt
3809 * Convert MP3 to a scrolling spectrum waterfall plot video
3810 http://jdesbonnet.blogspot.dk/2014/02/convert-mp3-to-scrolling-spectrum.html
3812 * PHP wrapper class for the GNU Parallel tool
3813 https://github.com/geopal-solutions/gnu-parallel-wrapper/tree/master
3815 * Exploratory Data Analysis http://www.slideshare.net/thinrhino/gnunify
3817 * Copias de archivos con rsync y parallel
3818 http://linuxmanr4.com/2014/02/20/copias-de-archivos-con-rsync-y-parallel
3820 * Single-Thread-Programme auf Multicore-Rechnern parallelisieren
3821 http://www.adlerweb.info/blog/2014/02/08/linux-single-thread-programme-auf-multicore-rechnern-parallelisieren
3823 * Распараллеливаем процессы для ускорения вычислений и выполнения
3824 заданий в Linux http://savepearlharbor.com/?p=210480
3826 * Bug fixes and man page updates.
3831 * GNU Parallel was cited in: On the likelihood of multiple bit upsets
3833 http://arxiv-web3.library.cornell.edu/pdf/1401.1003
3835 * HaploClique uses GNU Parallel
3836 https://github.com/armintoepfer/haploclique
3838 * Scraping NSScreencast
3839 https://blog.nicolai86.eu/posts/2014-01-12/scraping-nsscreencast/
3841 * 30 Cool Open Source Software I Discovered in 2013
3842 http://www.cyberciti.biz/open-source/30-cool-best-open-source-softwares-of-2013/
3844 * [Unix] 13. The power of doing things in Parallel
3845 http://leetaey.tistory.com/384
3847 * Parallel the execution of a job that read from stdin
3848 http://www.linuxask.com/questions/parallel-the-execution-of-a-job-that-read-from-stdin
3850 * Mon Make à moi (6:38-11:50)
3851 http://videos.rennes.inria.fr/ReNaBI-GO2013/indexPierreLindenbaum.html
3853 * Shell-Abarbeitung beschleunigen: Wie Sie mit parallelen Prozesse
3854 effizienter in der Shell arbeiten
3855 https://www.hosteurope.ch/blog/shell-abarbeitung-beschleunigen-wie-sie-mit-parallelen-prozesse-effizienter-in-der-shell-arbeiten/
3857 * Summary of GNU Parallel tutorial
3858 http://hacktracking.blogspot.dk/2014/01/gnu-parallel-tutorial.html
3860 * Bug fixes and man page updates.
3865 * GNU Parallel now has a motto: For people who live life in the
3868 * Detect if the buffer dir $TMPDIR runs out of space. This changes a
3869 central piece of code, making this release alpha quality.
3871 * --keep-order --(n)onall will sort according to the sshlogin.
3873 * Detect the number of CPUs on DEC Tru64.
3875 * GNU sql: --list-tables for sqlite3.
3877 * GNU Parallel was cited in: Variational Message-Passing: Extension to
3878 Continuous Variables and Applications in Multi-Target Tracking
3879 http://www.ics.uci.edu/~ajfrank/pubs/thesis.pdf
3881 * GNU Parallel was cited in: Genome Assembly: Scaffolding Guided by
3883 https://www.duo.uio.no/handle/10852/37431
3885 * GNU Parallel was cited in: Metagenomic analysis of Mariana Trench
3887 http://repositorio.ul.pt/handle/10451/9436
3889 * GNU Parallel was cited in: Diacritization, automatic segmentation
3890 and labeling for Levantine Arabic speech
3891 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642556
3893 * GNU Parallel was cited in: Investigation of emotion classification
3894 using speech rhythm metrics
3895 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642591
3897 * GNU Parallel was cited in: A Rhythm-Based Analysis of Arabic Native
3898 and Non-Native Speaking Styles
3899 http://www.ijsps.com/uploadfile/2013/1128/20131128014413279.pdf
3901 * GNU Parallel was cited in: Evolutionary optimization of wetlands
3903 http://dl.acm.org/citation.cfm?id=2480400
3905 * GNU Parallel was cited (unfortunately with wrong citation) in:
3906 RDBMS vs NoSQL: Performance and Scaling Comparison
3907 http://www.epcc.ed.ac.uk/sites/default/files/Dissertations/2012-2013/RDBMS%20vs%20NoSQL%20-%20Performance%20and%20Scaling%20Comparison.pdf
3909 * GNU Parallel was used (without proper citation) in: Comprehensive
3910 Analysis Pipeline for Discovery of Human Genetic Variation
3911 http://www.google.com/patents/US20130311106
3913 * Encrypt and decrypt in parallel with GPG
3914 http://blog.tkassembled.com/412/encrypt-and-decrypt-in-parallel-with-gpg/
3916 * Using GNU Parallel to create a SVM classifier
3917 http://ivanyu.me/blog/2013/12/01/parallel/
3919 * Parallel xz compression
3920 http://anthon.home.xs4all.nl/rants/2013/parallel_xz/
3922 * Got CPUs to burn? Put 'em to work with GNU parallel
3923 http://baoilleach.blogspot.dk/2013/11/got-cpus-to-burn-put-em-to-work-with.html
3926 http://pastebin.com/JmnB9ffq
3928 * Gnu Parallel for fun and profit
3929 https://gist.github.com/celoyd/f7eb55ad69c9b33fd8c3
3931 * Parallelization of Exploitation
3932 http://rantsideasstuff.com/parallelization-of-exploitation/
3934 * Running assemblies in parallel
3935 https://khmer-protocols.readthedocs.org/en/v0.8.3/metagenomics/4-assemble.html
3937 * Procesando la contabilidad del PP
3938 http://www.neorazorx.com/2013/07/procesando-la-contabilidad-del-pp.html
3940 * Mon make à moi (French)
3941 http://www.slideshare.net/lindenb/mon-make-moi-tout-sauf-galaxy
3943 * Bug fixes and man page updates.
3948 * A citation notice is printed on stderr only if stderr is a terminal,
3949 the user has not specified --no-notice and the user has not run
3950 --bibtex once. This makes the release alpha quality.
3952 * --compress will compress temporary files. If the output is big and
3953 very compressible this will take up less disk space in $TMPDIR and
3954 possibly be faster due to less disk I/O.
3956 * --compress-program comtrols which program to use for compressing
3959 * --bar show progress as a progress bar compatible with zenity.
3961 * --resume can now be used with --result: Jobs already run will be
3964 * --transfer and --basefile support paths relative to the --workdir by
3965 inserting /./ into the path.
3967 * GNU Parallel was cited in: fastphylo: Fast tools for phylogenetics
3968 http://www.biomedcentral.com/1471-2105/14/334/abstract
3970 * Using GNU parallel
3971 http://davetang.org/muse/2013/11/18/using-gnu-parallel/
3973 * Techlux - GNU - Parallel (German)
3974 https://techlux.de/blog/2013/11/07/gnu-parallel/
3976 * awk, sed, bzip2, grep, wc на всех ядрах
3977 http://vk.com/page-30666517_45528467
3979 * 如何利用多核CPU來加速你的Linux命令 — awk, sed, bzip2, grep, wc等
3980 http://www.hksilicon.com/kb/articles/290543/CPULinuxawk-sed-bzip2-grep-wc
3982 * GNU Parallel (Japanese)
3983 http://jarp.does.notwork.org/diary/201311b.html#20131117
3985 * Bug fixes and man page updates.
3990 * --transfer files with /./ in the path will copy the files relative
3993 * The maximal command length is now cached in a file halfing the
3996 * GNU Parallel was cited in: Investigating speaker gender using rhythm
3997 metrics in Arabic dialects
3998 http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6602389
4000 * GNU Parallel was cited in: Tiedon erist ̈minen ja visualisointi a
4001 lastensuojelun asiakaskertomuksista
4002 https://tampub.uta.fi/handle/10024/84978
4004 * Some Additional Useful Bioinformatics Software
4005 http://nix-bio.blogspot.dk/2013/10/additional-software-for-bioinformatics.html
4007 * GNU Parallel Example Screen Cast (bil to Geotiff conversion)
4008 http://www.youtube.com/watch?v=PpF27eC7Mys
4010 * Using GNU Parallel to roll-your-own Map Reduce!
4011 http://www.rankfocus.com/hello-world/
4013 * Use multiple CPU Cores with your Linux commands
4014 http://www.rankfocus.com/use-cpu-cores-linux-commands/
4016 * Using GNU Parallel at HPC @ Uni.lu
4017 https://hpc.uni.lu/users/use_cases/
4019 * Scaling up with parallelization
4020 https://www.msi.umn.edu/sites/default/files/AdvPython_1.pdf
4022 * How to teach yourself to be a technical tester
4023 http://infiniteundo.com/post/62421363463/qa-toc
4025 * Faster Rasters For All
4026 http://2013.foss4g.org/conf/programme/presentations/52/
4028 * Optimizing translated file downloads
4029 http://www.smartling.com/blog/2013/05/20/optimizing-translated-file-downloads/
4031 * EMC NetWorker parallel saveset cloning with nsrclone and GNU parallel
4032 http://www.beebotech.com.au/2013/10/emc-networker-parallel-saveset-cloning-with-nsrclone-and-gnu-parallel/
4034 * Best Practices for Amazon EMR
4035 http://media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf
4037 * Computing checksums for backup
4038 https://identi.ca/evan/note/6yf1GzAARtyBhj__xzMvAg
4040 * Un exemplu de utilizare a programului GNU parallel
4041 http://vundicind.blogspot.dk/2013/10/exemplu-utilizare-gnu-parallel.html
4044 http://www.slideshare.net/drakeguan/part1-23705978
4046 * なんか気持ちよかです Gnu Parallel
4047 http://a3-lab.jpn.org/note/%E3%81%AA%E3%82%93%E3%81%8B%E6%B0%97%E6%8C%81%E3%81%A1%E3%82%88%E3%81%8B%E3%81%A7%E3%81%99-gnu-parallel
4049 * Bug fixes and man page updates.
4054 * PDF-files of documentation is now included.
4056 * Cloning at warp speed 100 VMs in 1 minute using one command line
4057 http://www.beebotech.com.au/tag/command-line/
4059 * Calcul Quebec's introduction to GNU Parallel
4060 https://wiki.calculquebec.ca/w/GNU_parallel
4062 * Brincando com o GNU parallel
4063 http://blog.tadeucruz.com/2013/09/brincando-com-o-gnu-parallel/
4065 * GNU Parallelで並列処理を行う
4066 http://qiita.com/PENGUINANA_/items/af27a833e835fe17f09b
4068 * Bug fixes and man page updates.
4073 * A tutorial showing much of GNU Parallel's functionality. Spend an
4074 hour walking through the tutorial. Your commandline will love you
4075 for it. man parallel_tutorial
4077 * --line-buffer will buffer output on line basis. --group keeps the
4078 output together for a whole job. --ungroup allows output to mixup
4079 with half a line coming from one job and half a line coming from
4080 another job. --line-buffer fits between these two; it prints a full
4081 line, but will allow for mixing lines of different jobs.
4083 * --record-env records all variables and functions set. Useful to
4084 record the normal environment before using --env _.
4086 * --env _ exports all functions and variables to the remote server
4087 except for the ones recorded.
4089 * New signing key. Due to recommendations from NIST
4090 http://www.keylength.com/en/4/ the signing key was changed from
4091 1024D/ID:FFFFFFF1 to 9888R/ID:88888888.
4093 * Agalma: an automated phylogenomics workflow
4094 http://arxiv.org/pdf/1307.6432
4096 * Job ad asking for GNU Parallel expertise
4097 http://seattle.craigslist.org/est/sof/4006079352.html
4099 * Transient Beowulf Clustering with GNU Parallel and SSHfs
4100 http://www.reddit.com/r/linux/comments/1ka8mn/transient_beowulf_clustering_with_gnu_parallel/
4102 * Aligning to unique regions
4103 http://davetang.org/muse/2013/07/22/aligning-to-unique-regions/
4105 * Top 10 scripting tricks for basic bioinformatics
4106 http://students.washington.edu/bowmanjs/wordpress/?p=873
4108 * Using GNU Parallel to speed up and simplify data analyzes
4109 http://www.sergeymarkov.com/blog/2013/07/using-gnu-parallel-to-speed-up-and-simplify-data-analyzes/
4111 * Compression of files in parallel using GNU parallel
4112 http://codextechnicanum.blogspot.dk/2013/07/compression-of-files-in-parallel-using.html
4114 * Using GNU Parallel with Amazon
4115 media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf
4117 * Some useful comments on GNU Parallel
4118 https://news.ycombinator.com/item?id=6209767
4120 * Using GNU Parallel to count reads mapping to genes for multiple BAMs
4121 http://drduanehassane.com/blog/sequencing-resources
4123 * TimeMachineっぽいバックアップスクリプト
4124 http://rio.tc/2013/07/timemachine-1.html
4126 * GNU ParallelでAndroid NDKの全バージョンを一括ダウンロード
4127 http://qiita.com/mazgi/items/b10bf0ff3da2045d19ab
4129 * Bug fixes and man page updates.
4134 * --round-robin with --pipe will write all blocks to already running
4137 * --env can now transfer Bash function for remote execution. That is
4140 * GNU Parallel was used (unfortunately with improper citation) in:
4141 Understanding the Impact of E-Commerce Software on the Adoption of
4142 Structured Data on the Web
4143 http://link.springer.com/chapter/10.1007/978-3-642-38366-3_9#page-1
4145 * GNU Parallel was used (unfortunately with improper citation) in:
4146 CWI at TREC 2012, KBA track and Session Track
4147 http://trec.nist.gov/pubs/trec21/papers/CWI.kba.session.final.pdf
4149 * Mitigation of Adverse Effects Caused by Shock Wave Boundary Layer
4150 Interactions through Optimal Wall Shaping.
4151 http://arc.aiaa.org/doi/abs/10.2514/6.2013-2653
4153 * Using GNU parallel to convert images.
4154 http://www.brunokim.com.br/blog/?p=18
4156 * A quick way to parallelize.
4157 http://timotheepoisot.fr/2013/07/08/parallel/
4159 * GNU Parallel 20130522 ('Rana Plaza') 发布,并行作业执行.
4160 http://www.open-open.com/news/view/371301
4162 * Quite a few bug fixes and man page updates.
4167 * --xapply now recycles arguments if an input source has more
4168 arguments than others.
4170 * The sleep time between jobs is now both increased and decreased
4173 * 10 seconds installation check the signature using GnuPG if GnuPG is
4176 * Developer job asking for GNU Parallel expertise.
4177 http://careers.stackoverflow.com/jobs/35562/developer-big-data-geo-and-web-climate-central
4179 * A small utility program to run youtube-dl in parallel.
4180 https://github.com/dlh/youtube-dl-parallel
4182 * Parallelizing Freesurfer:
4183 http://blog.cogneurostats.com/?p=148
4185 * Bug fixes and man page updates.
4190 * --ctrlc is now default if --pipe is not used; thus making it
4191 possible to kill remotely started jobs simply by pressing Ctrl-C.
4193 * --timeout 200% now means kill jobs that take more than twice the
4194 time of the median run time of a job.
4196 * Jobs are now distributed round robin when having mulitiple
4197 --sshlogin instead of filling up one --sshlogin at a time.
4199 * niceload: darwin version of --io --mem --swap. Thanks to Anders F
4202 * Bug fixes and man page updates.
4207 * 10 seconds installation: wget -O - pi.dk/3 | sh
4209 * HPUX CPU/core detection. Thanks to Javier Tarradas.
4211 * CPU detection for HURD, IRIX, SCO OpenServer and (old) HPUX.
4213 * --ctrlc will send SIGINT to tasks running on remote computers and
4216 * --load now uses 'ps' to see immediately see the number of running
4217 processes instead of 'uptime' thus making --load react much faster.
4219 * Testing on Centos 3.9 and FreeBSD 7 revealed a lot of compability
4220 bugs. Some of these required quite extensive changes making this
4221 release beta quality.
4223 * --retries works with --onall.
4225 * The new --load computation now works on FreeBSD 7.
4227 * --nice works under tcsh.
4229 * GNU Parallel is officially supported in NetBSD.
4230 http://ftp.netbsd.org/pub/pkgsrc/current/pkgsrc/parallel/parallel/README.html
4232 * GNU Parallel is accepted for openSUSE.
4233 http://software.opensuse.org/package/gnu_parallel
4235 * GNU Parallel can be installed under Microsoft Windows (CygWin).
4236 http://blogs.msdn.com/b/hpctrekker/archive/2013/03/30/preparing-and-uploading-datasets-for-hdinsight.aspx
4238 * Excuses for not installing GNU Parallel.
4239 http://oletange.blogspot.dk/2013/04/why-not-install-gnu-parallel.html
4241 * Job advert that requires GNU Parallel competence.
4242 http://versium.com/about/careers/
4244 * Parallelizing Batch Jobs for Fun and Profit.
4245 http://mikeseidle.com/tech/programming/2013/03/parallelizing-batch-jobs
4247 * Processing Transcription Start Sites(TSS) for the entire Mouse genome.
4248 http://qbrc.swmed.edu/2013/03/gnu-parallel-speeding-up-unix-commands-and-scripts/
4250 * GNU parallel is used throughout Scrimer.
4251 http://scrimer.readthedocs.org/en/latest/
4253 * GNU Parallel helped making public documents searchable.
4254 http://danpalmer.me/blog/articles/2013-04-06-unlocking-hillsborough.html
4256 * Identifying big movie files (German).
4257 http://blackappsolutions.wordpress.com/2013/03/23/wenn-der-plattenplatz-knapp-wird-filme-identifizieren-die-viel-platz-belegen/
4259 * Bug fixes and man page updates.
4264 * --resume works with --pipe.
4266 * --resume-failed will go through --joblog, redo the failed jobs and
4267 then continue like --resume.
4269 * Negative positional arguments count from the end: {-1} means the
4270 last argument, {-2} the second to last.
4272 * NetBSD CPU detection.
4274 * --blocksize increases exponentially if it smaller than a full
4277 * Processing n-line records (--pipe -L n) is now much faster.
4279 * --tollef is obsoleted after discussion on the mailing list.
4281 * GNU Parallel is the highest rated tool on:
4282 http://www.biostars.org/show/tools/?sort=votes&since=all%20time
4284 * GNU Parallel was loved during FSFE's #ilovefs campaign.
4285 http://fsfe.org/news/2013/news-20130212-01.en.html
4287 * Using GNU Parallel with s3cmd (Japanese).
4288 http://blog.suz-lab.com/2013/02/s3cmd-gnu-paralells3.html
4290 * Intro to GNU Parallel (Chinese).
4291 http://guiquanz.github.com/2013/02/12/gnu-parallel-intro/
4293 * Bug fixes and man page updates.
4298 * --sshdelay Delay starting next ssh by secs seconds. GNU parallel
4299 will pause secs seconds after starting each ssh. secs can be less
4302 * Official OpenBSD port:
4303 http://ftp.openbsd.org/ports/sysutils/parallel/
4305 * Official DragonFlyBSD package:
4306 http://www.mirrorservice.org/sites/ftp.dragonflybsd.org/packages/amd64/DragonFly-3.0.0/stable/parallel/
4308 * Post about niceload in Hungarian:
4309 http://commandline.blog.hu/2013/01/02/niceload
4311 * 自炊スキャンデータをKobo Gloに最適化
4312 http://interstadial.wordpress.com/2013/01/20/
4314 * GNU parallel+ssh で複数のリモートホストに複数のコマンドを実行させる
4315 http://oshiire.to/archives/1686
4317 * Bug fixes and man page updates.
4322 * --shebang-wrap makes is possible to parallelize scripts by putting
4323 parallel in the shebang line (the first #! line in scripts).
4325 * --delay puts in a delay after starting each job. Useful to avoid
4326 raceconditions and thundering herd problems.
4328 * --results now uses / as separator instead of TAB and thus creates
4329 subdirs. Thanks to Drew Frank.
4331 * parallel: OpenBSD CPU detection. Thanks to Michał Markowski.
4333 * niceload --sensor allows for negative numbers to signify a lower
4334 number means the limit is lower.
4336 * niceload --prg suspend a named program that is already running.
4338 * niceload multiple --pid suspend process ids that are already running.
4340 * Convertir des images avec find et imagemagick
4341 http://roger.b.over-blog.com/article-convertir-des-images-avec-find-et-imagemagick-113416637.html
4343 * Bug fixes and man page updates.
4348 * niceload --sensor makes it possible to use a program to control if a
4349 program should be suspended.
4351 * GNU Parallel was part of the justification for Nordic Free Software
4353 https://fsfe.org/news/2012/news-20121112-01.html
4355 * Dateien schneller packen und konvertieren mit GNU parallel
4356 http://www.linux-community.de/Archiv/Tipp-der-Woche/Dateien-schneller-packen-und-konvertieren-mit-GNU-parallel
4358 * Processing images from Lunar Reconnaissance Orbiter Narrow Angle
4359 Camera http://lunokhod.org/?p=774
4361 * GNU Parallel is used in types2: Type and Hapax Accumulation Curves
4362 http://www.cs.helsinki.fi/u/josuomel/types2/
4364 * GNU Parallel used in: A Hybrid Factor Analysis and Probabilistic
4365 PCA-based system for Dictionary Learning and Encoding for Robust
4367 http://www.superlectures.com/odyssey2012/lecture.php?id=8&lang=en
4368 http://www.cse.iitm.ac.in/~mrsri/ppca.pdf
4370 * Mapreduce avec parallel, cat et une redirection
4371 http://datacratic.com/site/blog/mapreduce-avec-parallel-cat-et-une-redirection
4373 * GNU Parallel for Large Batches of Small Jobs
4374 https://support.scinet.utoronto.ca/wiki/images/7/7b/Tech-talk-gnu-parallel.pdf
4376 * GNU Parallel used in black belt tip (8:50-10:12)
4377 https://aws.amazon.com/apac/awspodcast/episode20/
4379 * Bug fixes and man page updates.
4384 * --results structures output files so they can be imported using
4385 Pandas (http://pandas.pydata.org/). Useful when doing simulations to
4386 select output from some arguments.
4388 * Use --env to transfer environment variables through ssh to remote
4391 * GNU Parallel is accepted for Ubuntu Quantal.
4392 http://packages.ubuntu.com/quantal/parallel
4394 * GNU Parallel was requested for OpenSUSE (go vote!)
4395 https://features.opensuse.org/314461
4397 * Kneth's Korner: Map/Reduce and GNU Parallel
4398 http://kenneth.geisshirt.dk/2012/10/mapreduce-and-gnu-parallel.html
4400 * Blog post in Japanese by Siguniang.
4401 https://siguniang.wordpress.com/2012/09/09/notes-on-gnu-parallel-the-command-line-power-tool/
4402 (Siguniang mentions the logo is called 'The Cafe Wall Illusion')
4403 http://www.michaelbach.de/ot/ang_cafewall/index.html
4405 * GNU Parallel, where have you been all my life?
4406 http://ssdigit.nothingisreal.com/2012/09/gnu-parallel-where-have-you-been-all-my.html
4408 * Reference-free ddRADseq analysis tools uses GNU Parallel.
4409 https://github.com/brantp/rtd#readme
4411 * When bash just isn’t quick enough.
4412 https://soimasysadmin.wordpress.com/2012/08/15/gnu-parallel-when-bash-just-isnt-quick-enough/
4414 * Using GNU Parallel to Package Multiple Jobs in a Single PBS Job.
4415 http://www.nas.nasa.gov/hecc/support/kb/Using-GNU-Parallel-to-Package-Multiple-Jobs-in-a-Single-PBS-Job_303.html
4417 * GNU Parallel Notes.
4418 http://xed.ch/help/parallel.html
4420 * Bug fixes and man page updates.
4425 * Due to a bugfix the main flow has changed. Making this release beta
4428 * Parallel Proxy Scraper & Checker Tool
4429 https://www.youtube.com/watch?v=iXCeR_XsP6o
4431 * Bug fixes and man page updates.
4436 * GNU Parallel was presented at Chiang Mai Bar Camp
4437 http://barcampchiangmai.org/
4439 http://www.cnx-software.com/2012/07/02/use-gnu-parallel-to-speed-up-script-execution-on-multiple-cores-andor-machines/
4441 * I don't always max out all my CPUs, but when I do, I do it with GNU
4443 http://memegenerator.net/instance/22638454
4445 * Bug fixes and man page updates.
4450 * '-L n --pipe' will use records of n lines. This is useful when
4451 processing data that have fixed records with a fixed number of
4454 * --filter-hosts will remove down hosts. For each remote host: check
4455 that login through ssh works. If not: do not use this host.
4456 Currently you can not put --filter-hosts in a profile, $PARALLEL,
4457 /etc/parallel/config or similar. This is because GNU Parallel uses
4458 GNU Parallel to compute this, so you will get an infinite loop. This
4459 will likely be fixed in a later release.
4461 * --pipe now uses fork() instead of busy wait. The performance should
4462 be better on computers with >10 cores while remaining the same on
4463 computers with few cores.
4465 * GNU Parallel will be represented at Chiang Mai Bar Camp.
4466 http://barcampchiangmai.org/
4468 * Indexing Big Data on Amazon AWS: The Screencast
4469 (Check out his T-shirt at 18:40-21:00).
4470 http://www.opensourceconnections.com/2012/06/06/indexing-big-data-on-amazon-aws-screencast/
4472 * biotoolbox uses GNU Parallel.
4473 https://code.google.com/p/biotoolbox/wiki/Pod_novo_wrapper
4475 * Spiceweasel uses GNU Parallel.
4476 https://github.com/mattray/spiceweasel
4478 * GNU Parallel part of The Administrators Challenge.
4479 http://challenge.twistedrack.com/questions/qs3.php
4481 * Finding Oldest Firefox Code using GNU Parallel.
4482 http://gregoryszorc.com/blog/2012/06/18/finding-oldest-firefox-code/
4484 * Bug fixes (quite a few for remote job running) and man page updates.
4489 * Timings in --joblog now with milliseconds.
4491 * Thesis using GNU Parallel (correctly cited; hooray!).
4492 http://scholarworks.sjsu.edu/etd_projects/222/
4495 http://www.perzl.org/aix/index.php?n=Main.Parallel
4497 * Prokka uses GNU Parallel.
4498 http://bioinformatics.net.au/prokka-manual.html
4500 * GNU Parallel was presented at MUUG.
4501 http://muug.mb.ca/blog/meetings/2012/05/09/may-8th-2012-rtfm-gnu-parallel1/
4503 * Blog post: Manipulating many or large files with GNU parallel.
4504 http://compbiously.blogspot.com/2012/05/manipulating-many-or-large-files-with.html
4506 * Blog post: Running commands in parallel using bash.
4507 http://blog.michaelboman.org/2012/04/running-commands-in-parallel-using-bash.html
4509 * Blog post in Hungarian.
4510 http://commandline.blog.hu/2012/05/03/gnu_parallel
4512 * Popularity of GNU Parallel in Debian explodes.
4513 http://qa.debian.org/popcon-graph.php?packages=parallel
4515 * Bug fixes and man page updates.
4520 * A race condition bug caused restructuring of a central piece of the
4521 code. Thus this release of GNU Parallel should be considered beta
4524 * sql --dbsize will now list sizes of all databases if given no
4527 * GNU Parallel is now in Debian Unstable.
4528 apt-get install parallel
4530 * Article: Computational and experimental analyses of
4531 retrotransposon-associated minisatellite DNAs in the soybean genome.
4532 http://www.biomedcentral.com/content/supplementary/1471-2105-13-s2-s13-s1.pdf
4534 * Blog post: GNU parallel - the best thing since sliced bread.
4535 https://arrayal.wordpress.com/2012/03/27/gnu-parallel-the-best-thing-since-sliced-bread/
4537 * Blog post: GNU Parallel makes everything faster.
4538 http://compbiously.blogspot.com/2012/03/gnu-parallel-makes-everything-faster.html
4540 * Blog post (German): Howto: GNU parallel.
4541 http://d24m.de/2012/04/05/howto-gnu-parallel/
4543 * Blog post: Running in Parallel
4544 http://interactivity.ifactory.com/2012/04/running-in-parallel/
4546 * 20000 watched the first intro video.
4549 * The first 5 have received their GNU Parallel merchandise
4550 https://www.gnu.org/software/parallel/merchandise.html
4552 * Bug fixes and man page updates.
4557 * Parallel Process Database Dumps.
4558 http://blog.mattoates.co.uk/2012/02/parallel-process-database-dumps.html
4560 * Using GNU Parallel to process images from Mars.
4561 http://lunokhod.org/?p=468
4563 * Using GNU Parallel with bzgrep.
4564 http://filip.rembialkowski.net/did-you-know-gnu-parallel/
4566 * Bug fixes and man page updates.
4571 * --workdir . will use the current working dir. If the current working
4572 dir is beneath your home dir, the value . is treated as the relative
4573 path to your home dir. This means that if your home dir is different
4574 on remote computers (e.g. if your login is different) the relative
4575 path will still be relative to your home dir.
4577 * A texinfo file is now generated from the POD file using pod2texi.
4579 * The bioinformatics article "Fast large-scale clustering of protein
4580 structures using Gauss integrals" mentions GNU Parallel. They forgot
4581 to add the reference. Please remember --bibtex if you use GNU
4582 Parallel in an article.
4583 http://bioinformatics.oxfordjournals.org/content/28/4/510.short
4585 * The first supporter received his merchandise. Did you order yours?
4586 https://www.gnu.org/software/parallel/merchandise.html
4588 * How to use GNU Parallel with samtools.
4589 http://zvfak.blogspot.com/2012/02/samtools-in-parallel.html
4591 * How to use GNU Parallel for vacuuming PostgreSQL tables.
4592 http://blog.timmattison.com/archives/2012/01/24/mini-hack-parallel-vacuuming-in-postgresql/
4594 * Converting e-books with Calibre and GNU Parallel.
4595 http://www.linkhal.de/blog/2012/01/converting-massive-e-book-collections-with-calibre-and-gnu-parrallel/
4597 * Using GNU Parallel for tailing logfiles from multiple servers.
4598 http://silviud.blogspot.com/2012/02/shell-parallel-processing.html
4600 * Bug fixes and man page updates.
4605 * --header : uses the first input line as column names and you can
4606 then use {colname} as a replacement string in the command. This also
4607 works with multiple :::'s.
4609 * --header <regexp> matches a header as a regular expression and
4610 repeats the header for each block with --pipe.
4612 * --resume resumes from the last unfinished job. Useful if you stop
4613 GNU Parallel and restart it later with the same arguments.
4615 * niceload now propagates exit status correctly.
4617 * Show your support for GNU Parallel. For a limited time you can get a
4618 GNU Parallel T-shirt+mug+pen+100 postcards at 20 EUR. See
4619 https://www.gnu.org/software/parallel/merchandise.html
4621 * Options -g -B -T -U -W -Y are retired as warned 6 months ago.
4623 * GNU Parallel referenced in article on Holographic Grid Cloud. Thanks
4624 to Stefano Gallozzi. http://arxiv.org/pdf/1112.6128
4626 * Article in IEEE Software on GNU Parallel. Thanks to Diomidis
4627 Spinellis. http://www.spinellis.gr/blog/20110911/
4629 * An article on Narwhal which uses GNU Parallel. They forgot to add
4630 the reference. Please remember --bibtex if you use GNU Parallel in
4632 http://bioinformatics.oxfordjournals.org/content/early/2011/11/08/bioinformatics.btr613.full.pdf
4634 * Blog post on using GNU Parallel to speed up BLAST queries:
4635 http://blog.mckuhn.de/2012/01/embarrassingly-parallel-blast-search.html
4637 * Video showing Wake-on-LAN with GNU Parallel.
4638 https://www.youtube.com/watch?v=0mB-yIyKFLQ
4640 * Using GNU Parallel with Solr.
4641 http://sujitpal.blogspot.com/2011/12/solr-report-generation-with-python.html
4643 * First job ad including GNU Parallel:
4644 http://seeker.dice.com/jobsearch/servlet/JobSearch?op=101&dockey=xml/7/6/76f858de083a094f74b1a5d3ba53ffc5@endecaindex
4646 * Bug fixes and man page updates.
4651 * --timeout will now kill grandchildren.
4653 * Interview in Hacker Public Radio.
4654 http://hackerpublicradio.org/eps.php?id=0860
4656 * Blog post in Chinese.
4657 http://blog.sina.com.cn/s/blog_3f7652740100y0ju.html
4659 * Bug fixes and man page updates.
4664 * GNU Parallel package for Fedora.
4665 https://admin.fedoraproject.org/pkgdb/acls/name/parallel
4667 * Using GNU Parallel with Mozilla cross referencing.
4668 https://blog.mozilla.com/it/2011/11/15/mxr-improvements/
4670 * Neat flash presentation of GNU Parallel.
4671 http://prezi.com/0nq74b2elgtx/about-gnu-parallel/
4673 * How to create tar files of dirs in parallel.
4674 https://joneslee85.wordpress.com/2011/11/22/shell-tips-how-to-recursively-archive-many-folders/
4676 * Article in Admin Network&Security by Ben Martin.
4677 http://www.admin-magazine.com/HPC/Articles/GNU-Parallel
4679 * Blog post in Polish.
4680 http://blog.tiger.com.pl/2011/01/05/gnu-parallel/
4682 * Blog post on using GNU Parallel of Mac OS X.
4683 http://www.0xcb0.com/2011/10/19/running-parallel-bash-tasks-on-os-x/
4685 * Blog post in English by researcher.
4686 http://zandyware.wordpress.com/2011/10/15/gnu-parallell-make-best-use-of-your-multicore-computer/
4688 * Blog entry in Chinese.
4689 http://blog.csdn.net/tossense/article/details/6889026
4691 * Blog entry in Japanese on managing many servers.
4692 http://hiroakis.com/blog/2011/11/13/gnu-parallel/
4694 * GNU Parallel is now part of ppbs.
4695 http://physiology.med.cornell.edu/faculty/mason/lab/ppbs/introduction/introduction.html
4697 * How to use GNU Parallel with MCX.
4698 http://mcx.sourceforge.net/cgi-bin/index.cgi?MMC/Doc/MMCCluster
4700 * Bug fixes and man page updates.
4705 * --tag prepends lines with the argument(s). If used with --(n)onall
4706 the line will be prepended with the sshlogin instead.
4708 * --shellquote does not run the command but quotes it using \'s.
4709 Useful for making quoted composed commands.
4711 * --profile can now be repeated merging multiple profiles.
4713 * --bibtex now gives the BibTeX entry.
4714 Thanks to Aleksandr Levchuk for testing.
4716 * Makefile for simple .deb package.
4717 cd packager/debian; make
4719 * sql: --list-databases lists the databases.
4721 * GNU Parallel officially in Fedora 16
4722 http://www.spinics.net/lists/fedora-package-announce/msg67130.html
4724 * Blog post on recompression FLAC audio.
4725 http://blog.oxplot.com/2011/08/reflac-flac-cleanser.html
4727 * The most complex use of ::: I have seen so far.
4728 http://agentzlerich.blogspot.com/2011/09/following-up-on-previous-failures-ive.html
4730 * Example of using GNU Parallel with sudo.
4731 http://loopkid.net/articles/2011/10/07/recursive-chmod-and-chown-on-files
4733 * Use wget and gnu parallel to download mp3s at rocket speed.
4734 http://sdbrain.posterous.com/use-wget-and-gnu-parallel-to-download-mp3s-at
4736 * First CV referring to GNU Parallel.
4737 http://www.peopleperhour.com/freelancers/stephen_/internet_researcher_and_protocol_develop/140602
4739 * Cartwright labs usage of GNU Parallel.
4740 http://cartwrightlab.wikispaces.com/The+Most+Bang+for+Your+Buck
4742 * Bug fixes and man page updates.
4747 * --timeout implemented so that slow commands can be killed
4749 * CPU detection improved for Mac OSX. Thanks to Wayne E. Seguin.
4751 * Example of a parallel webcrawler in the man page.
4753 * Backup up PostgreSQL with GNU Parallel. Thanks to Stephane Wirtel.
4754 http://wirtel.be/2011/07/15/rsync_parallel/
4756 * Blog post in Japanese.
4757 http://dminor11th.blogspot.com/2011/08/gnu-parallel.html
4759 * Blog post about optimizing JPEGs. Thanks to Thomas Jost.
4760 http://schnouki.net/2011/07/22/optimizing-jpeg-pictures/
4762 * Bug fixes and man page updates.
4767 * niceload: --hard will suspend a program if a limit is reached - as
4768 opposed to just slowing the program down.
4770 * niceload: --soft will slow the program down - as opposed to
4771 suspending the program completely.
4773 * niceload: --run-io will slow down a program if disk io goes above a
4776 * niceload: --run-load will slow down a program if loadaverage goes
4777 above a certain limit.
4779 * niceload: --run-mem will slow down a program if free memory goes
4780 below a certain limit.
4782 * niceload: --run-noswap will slow down a program if the computer is
4785 * niceload: --start-io, --start-load, --start-mem, --start-noswap will
4786 defer starting a program until the system is below the limit.
4788 * --io, --load, --mem, and --noswap sets both --run-* and --start-*.
4790 * niceload got a major rewrite and is now object oriented.
4792 * GNU Parallel was presented at Nordic Perl Workshop 2011.
4793 http://conferences.yapceurope.org/npw2011/talk/3416
4795 * Blog post about zcat and GNU Parallel. Thanks to Dr. John.
4796 http://drjohnstechtalk.com/blog/2011/06/gnu-parallel-really-helps-with-zcat/
4798 * 2 blog posts in Japanese. Thanks to Negima.
4799 http://d.hatena.ne.jp/negima1976/20110607/1307412660
4800 http://d.hatena.ne.jp/negima1976/20110628/1309252494
4802 * Blog post for bioinformatics. Thanks to Chris Miller.
4803 http://chrisamiller.com/science/2010/05/26/use-parallel-for-easy-multi-processor-execution/
4805 * Bug fixes and man page updates.
4810 * --onall will run all the jobs on all the computers. This is useful
4811 for systemadinistrators having multiple servers.
4813 * --nonall runs like --onall but reads no arguments from stdin
4814 (standard input), so is possible to do:
4815 parallel --nonall -S computer1,computer2 uptime
4817 * Context replace now works with multiple input sources:
4818 parallel -X echo {1}-{2} ::: 1 2 3 ::: a b c
4820 * --noswap do not start a job on a server that is swapping.
4822 * Article: Parallel processing without Hadoop!
4823 http://www.solutionhacker.com/parallel-processing-without-hadoop/
4825 * Article in Linux Magazine (Spanish). Thanks to Ben Martin.
4826 http://www.linux-magazine.es/issue/67/
4828 * First blog post in Korean. Thanks to 민병국.
4829 http://blog.daum.net/_blog/BlogTypeView.do?blogid=02RQ3&articleno=13380895&admin=#
4831 * Blog post in Japanese. Thanks to Naoya Nakazawa.
4832 http://www.sssg.org/blogs/naoya/archives/2003
4834 * Blog post in English. Thanks to Dagon.
4835 http://hekate.homeip.net/2011/05/29/
4837 * Bug fixes and man page updates.
4842 * Multiple ::: can be put on the command line and will be treated
4843 similar to contents from multiple -a's.
4845 * ::: and :::: can now be mixed on the command line. Use {1} .. {n} to
4846 refer to inputs from the different input sources.
4848 * --xapply is now needed to get xapply's behaviour of reading one line
4849 from each of the input sources.
4851 * Multiple input sources will cause all combinations of arguments from
4852 the sources to be generated. E.g. 'parallel echo {1}+{2} ::: 1 2 :::
4853 a b c' will print 1+a 1+b 1+c 2+a 2+b 2+c. This can often replace
4856 * Implemented {//} for the input line with the basename removed (dirname).
4858 * New video showing the new ::: and :::: input sources.
4859 http://tinyogg.com/watch/iOdhU/ http://www.youtube.com/watch?v=fOX1EyHkQwc
4861 * GNU Parallel now has a logo.
4862 http://www.gnu.org/software/parallel/logo.png
4864 * Article about GNU SQL in USENIX Magazine ;login: (print)
4865 http://www.usenix.org/publications/login/2011-04/
4867 * Using GNU Parallel with EC2. Thanks to Kevin Wu.
4868 http://blog.kevinformatics.com/post/4970574713/interested-in-your-experience-using-gnu-parallel-in
4870 * Review with idea for {..} and {...} in Japanese. Thanks to ichii386.
4871 http://d.hatena.ne.jp/ichii386/20110426
4873 * Upgrade GNU Parallel using Macports. Thanks to Phil Hollenback.
4874 http://www.hollenback.net/index.php/MacportsParallel
4876 * Robert from Echo One discusses using processes instead of threads:
4877 http://rrees.wordpress.com/2011/04/25/many-cores-many-threads/
4879 * How to run GNU Parallel on a SLURM cluster. Thanks to Kevin Stock.
4880 http://www.kevinstock.org/2011/04/using-the-ri-cluster/
4882 * Short article about using GNU Parallel with lame:
4883 http://loopkid.net/articles/2011/04/30/accelerate-lame-mp3-conversion
4885 * Using GNU Parallel to run tail -f in Japanese. Thanks to Clouder.
4886 http://blog.clouder.jp/archives/001140.html
4888 * BBC Research & Development uses GNU Parallel:
4889 http://www.bbc.co.uk/blogs/researchanddevelopment/2010/11/prototyping-weeknotes-41-26112.shtml
4891 * Short article about using GNU Parallel on RHEL. Thanks to Rishi Deshpande.
4892 http://nuclear-imaging.info/site_content/2011/05/11/gnu-parallel/
4894 * Using GNU Parallel for FLAC->MP3 conversion. Thanks to Derek Marcotte.
4895 http://derek.chezmarcotte.ca/?p=286
4897 * Bug fixes and man page updates.
4902 * {#} now works as an alias for $PARALLEL_PID.
4904 * --eta now estimates way more accurately.
4906 * CPU detection code for AIX thanks to Christian Netrwal.
4908 * --joblog contains exitcode.
4910 * Thanks to Ævar Arnfjörð Bjarmason for reading my code.
4912 * GNU Parallel was presented at:
4913 - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm
4914 - OSAA.dk, Aarhus, 2011-04-12
4916 * Blog entry in Japanese. Thanks to Riywo.
4917 http://blog.riywo.com/2011/04/19/022802
4919 * Example of how to use GNU Parallel on PBS clusters. Thanks to Andrew
4920 J Dolgert: http://web0.tc.cornell.edu/wiki/index.php?title=Gnu_Parallel
4922 * First example of using GNU Parallel in Hebrew. Thanks to omry.
4925 * Intro video got past 10000 hits.
4926 http://www.youtube.com/watch?v=OpaiGYxkSuQ
4928 * Bug fixes and man page updates.
4933 * --tollef to be switch compatible with Tollef's parallel. This will
4934 cause -l to mean --load, and the argument separator will be --
4937 * --gnu will force GNU Parallel to behave like GNU Parallel even if
4940 * Site wide config file: /etc/parallel/config
4942 This should solve the issue with some packagers renaming GNU
4943 Parallel to gparallel to avoid the naming conflict.
4945 By putting --tollef in the site wide config file you can deinstall
4946 Tollef's parallel and install GNU Parallel instead without any
4947 change for users or scripts. This is useful for packagers that
4948 currently rename GNU Parallel or simply do not distribute GNU
4949 Parallel because the command name conflicts with Tollef's parallel.
4951 * -L 0 -n 0, and -N 0 implemented. They will read one argument,
4952 but insert 0 arguments on the command line. Useful if you just want
4953 to run the same command with the same arguments a number of times.
4955 * GNU Parallel is now in Fink. Thanks to Jesse Alama.
4956 http://pdb.finkproject.org/pdb/package.php/parallel
4958 * Opscode Cookbook for Chef. Thanks to Joshua Timberman.
4959 https://github.com/opscode/cookbooks/tree/master/gnu_parallel
4961 * Man page examples translated into Japanese. Thanks to Koshigoe.
4962 http://w.koshigoe.jp/study/?%5Bsystem%5D+GNU+parallel+%BB%C8%CD%D1%CE%E3#l13
4964 * GNU Parallel will be presented at:
4965 - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm
4966 - OSAA.dk, Aarhus, 2011-04-12
4968 * Video of presentation from FSCONS 2010-11-07. The presenter was
4969 _really_ hoarse that day (Something to do with loads of alcohol the
4970 night before). http://vimeo.com/20838834
4972 * Review with examples in German. Thanks to M. Nieberg.
4973 http://kenntwas.de/2011/linux/gnu-parallel/
4975 * A review of the --pipe option in German. Thanks to Mathias Huber.
4976 http://www.linux-magazin.de/NEWS/GNU-Parallel-20110205-stueckelt-Daten
4978 * A small example of grepping maillogs. Thanks to François Maillet.
4979 http://www.francoismaillet.com/blog/?p=399
4981 * Using GNU Parallel instead of xargs. Thanks to James Cuff.
4982 http://blog.jcuff.net/2011/02/on-train-ride-in.html
4984 * Bug fixes and man page updates.
4989 * --pipe splits piped data into blocks. Each block is piped to a
4990 program for processing. The piping and the programs will be run in
4991 parallel. Useful if the data you want to process is data for a
4992 program and not arguments.
4994 * --blocksize sets the blocksize in bytes for --pipe. The blocksize is
4995 approximate. It can deviate as much as the size of one record.
4998 * --recstart sets the string matching the start of a
4999 record. Default is "".
5001 * --recend sets the string matching the end of a
5002 record. Default is '\n'. To specify none use --recend "".
5004 If both --recstart and --recend are set, the end of a record must be
5005 followed immediately by a start of a record. This is useful if
5006 either recend or recstart can occur in the middle of a record.
5008 * --remove-rec-sep removes the string matched by --recstart and
5011 * --regexp will make GNU Parallel treat --recstart and --recend as
5012 regular expressions.
5014 * --output-as-files will put the output of the programs into files and
5015 instead of giving the output GNU Parallel will output the name of
5018 * -N if used with --pipe sets the number of records to read.
5020 * New video showing --pipe at
5021 http://www.youtube.com/watch?v=1ntxT-47VPA
5023 * GNU Parallel was presented at FOSDEM.
5025 * Article in USENIX Magazine ;login: (print)
5026 http://www.usenix.org/publications/login/2011-02/
5028 * GNU Parallel is now on ohloh.net. Thanks to Wim Muskee.
5029 https://www.ohloh.net/p/gnu-parallel
5031 * Advanced recursive example. Thanks to Ruarí Ødegaard.
5032 http://my.opera.com/ruario/blog/2011/01/24/editing-debian-packages-more-fun-with-gnu
5034 * Small example on using GNU Parallel through 0install (German).
5035 http://forum.ubuntuusers.de/topic/gnu-parallel-mit-zero-install-kurzinfo-kein-wi/
5037 * Bug fixes and man page updates.
5042 * --joblog makes a simple log of completed jobs.
5044 * -X now spreads arguments between job slots when reaching last
5045 argument. Use -j1 to avoid this.
5047 * People on the email list have voted -j+0 to be the new default
5050 * First review in Polish. Thanks to Patryk Krawaczyński.
5051 http://nfsec.pl/root/2458
5053 * Review in Spanish (in print).
5054 https://www.linux-magazine.es/issue/67/moreinfo.html
5056 * Review in English. Thanks to Brian Gough.
5057 http://blogs.fsfe.org/bjg/2011/01/gnu-parallel-a-map-operator-for-the-command-line/
5059 * Review in French. Thanks to Denis Dordoigne.
5060 http://linuxfr.org/2010/12/29/27715.html
5062 * Review in Spanish.
5063 http://gufete.net/index.php?entry=entry110116-200022
5065 * Article with advanced recursive example. Thanks to Ruarí Ødegaard
5066 http://my.opera.com/ruario/blog/2011/01/18/fun-with-gnu-parallel
5068 * Use case for memcache.
5069 http://www.dctrwatson.com/2010/12/how-to-dump-memcache-keyvalue-pairs-fast/
5071 * Bug fixes and man page updates.
5076 * GNU niceload is now part of GNU Parallel. GNU niceload slows down a
5077 program if the load average is above a certain limit.
5079 * Implemented --tmpdir to buffer standard output and standard error in
5082 * Implemented --load to wait until the load is below a limit before
5083 starting another job on that computer.
5085 * Implemented --nice set the niceness of jobs running both locally and
5088 * Implemented --dry-run to print the job without running it.
5090 * Implemented --tty as the old default of assigning a tty to the first
5091 job causes problems.
5093 * Review with focus on clusters. Thanks to Taylor Gillespie
5094 http://www.unixpronews.com/unixpronews-49-20101019GNUParallelSpeedUpProcessingWithMulticoresClusters.html
5096 * Review with focus on protein similarity.
5097 http://kevinformatics.tumblr.com/post/2142473893/cluster-like-computing-using-gnu-parallel
5099 * Review in Spanish.
5100 http://gr3p.com/2010/12/gnu-parallel-acelera-tus-scripts-en-linux
5102 * Quite a few bug fixes and man page updates.
5107 * Implemented {/} for the input line with the path removed (basename).
5109 * Implemented {/.} for the input line with extension and path removed
5112 * Output from --progress is now sent to standard error instead of
5115 * --eta was broken and counted down from 0. Now fixed.
5117 * Standard output and standard error are flushed after every job so if
5118 standard output does not end with a newline it will still be grouped
5119 with the rest of standard output.
5121 * --command, -c, --file, and -f are now removed as options. They were
5122 never used in practice.
5124 * GetOptionsFromArray rewritten to work with old Perl libraries.
5126 * The file COPYING now contains the GNU General Public License 3
5128 * Major rewrite to make the code more object oriented and easier to
5129 maintain in the future.
5134 * Using -j myfile the number of jobs can be changed while GNU Parallel
5135 is running simply by changing the content of myfile.
5137 * Implemented --profile to use different .parallel/config for
5138 different situations.
5140 * Ugly newlines in $PARALLEL and .parallel/config are no longer
5141 needed. Instead you have to use \ in front of special shell
5144 * --workdir puts the files transferred to remote machines in a
5145 specified directory.
5147 * $PARALLEL_PID is set to the process id of GNU Parallel.
5149 * $PARALLEL_SEQ is set to the sequence number of the job.
5151 * -v now only shows the command to run. Use -v -v to show the
5154 * Slow spawning error is now only a warning.
5156 * If stdin is a tty and input is read from stdin you now get a
5159 * GNU sql: \n and \x0a in arguments is replaced with newline.
5161 * Patch for Debian package and spelling mistakes. Thanks to Rogério
5162 Brito <rbrito at ime dot usp dot br>
5164 * Mac OS X Homebrew package. Thanks to Jonathan Palardy <jonathan dot
5165 palardy at gmail dot com>
5167 * FreeBSD port. Thanks to Chris Howey <howeyc at gmail dot com>
5169 * Pardus package. Thanks to Fethican Coşkuner
5170 <fethicanc at gmail dot com>
5172 * First review in Chinese. Thanks to 曾義峰:
5173 http://antbsd.twbbs.org/~ant/wordpress/?p=2876
5175 * First review in print:
5176 http://www.linux-magazine.com/Issues/2010 Nov 2010
5178 * First review in Spanish:
5179 http://www.muylinux.com/2010/10/18/gnu-parallel-computacion-paralela-a-golpe-de-comando
5181 * First review in Dutch thanks to Koen Vervloesem <koen at vervloesem
5183 http://techworld.nl/technologie/33493/gebruik-al-je-processorkernen-met-gnu-parallel.html
5185 * Blog review thanks to R. Tyler Croy <tyler at monkeypox dot org>:
5186 http://unethicalblogger.com/posts/2010/11/gnuparallel_changed_my_life
5188 * 5000 views of the intro video:
5189 http://www.youtube.com/watch?v=OpaiGYxkSuQ
5191 * As usual a bunch of bugfixes and more usage examples in the man
5194 * GNU Parallel was presented at FSCONS 2010-11-07:
5195 http://www.fscons.org/fs/gnu-parallel Hopefully the
5196 video will be online soon.
5201 * See GNU Parallel live at FSCONS 2010-11-07:
5202 http://www.fscons.org/fs/gnu-parallel
5204 * Untested Debian and xUbuntu packages available through OpenSUSE
5206 https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
5208 * Using --retries a job will be retried on another computer if it
5209 fails. This is useful if some jobs fail for no apparent reason (such
5210 as network failure).
5212 * BSD xargs -o (open /dev/tty) is now default for the job running in
5213 foreground. Useful for interactive commands like:
5214 ls | parallel -Xuj1 vi
5216 * GNU sql now supports SQLite.
5218 * Renamed .dburl.aliases to .sql/aliases and /etc/sql/aliases.
5220 * GNU sql now support --list-tables
5222 * Alias for DBURL can contain '?query' part with %-quoting.
5227 * Using --shebang GNU Parallel can be used as the parser for a script.
5228 E.g: #!/usr/bin/parallel --shebang traceroute (followed by lines of
5231 * First community generated bugfixes
5233 * Alt Linux package of GNU Parallel. Thanks to Michael Shigorin <mike
5234 at altlinux dot org>
5236 * Sunfreeware package of GNU Parallel. Thanks to Steven M. Christensen
5237 <sunfreeware at gmail.com>
5239 * Untested CentOS, Fedora, Mandriva, RedHat, and SUSE packages
5240 available through OpenSUSE build service:
5241 https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
5243 * Review of GNU Parallel. Thanks to Andrew McFague amcfague at wgen dot net
5244 http://www.andrew-mcfague.com/linux/utilities-linux/
5245 commands-every-serious-nix-user-should-know/#parallel
5247 * First 1000 views of the intro video
5249 * sql - a small script to access sql bases from the command line which
5250 is a handy companion to parallel --colsep
5255 * Counting semaphore functionality: start a job in the background. If
5256 N jobs are already running, wait for one to complete. Examples:
5257 sem 'sleep 2; echo foo'; sem 'sleep 1; echo bar'; sem --wait
5258 sem -j2 'sleep 2; echo foo'; sem -j2 'sleep 1; echo bar'; sem --wait
5260 * With --colsep a table can be used as input. Example:
5261 cat tab_sep_table | parallel --colsep '\t' echo col1 {1} col2 {2}
5263 * --trim can remove white space around arguments.
5265 * --sshloginfile '..' means use ~/.parallel/sshloginfile
5267 * Zero install package. Thanks to Tim Cuthbertson <tim3d dot junk at
5270 * OpenSUSE package. Thanks to Markus Ammer <mkmm at gmx-topmail dot
5273 * NixOS package. Thanks to Ludovic Courtès <ludo at gnu dot org>
5275 * Web review http://oentend.blogspot.com/2010/08/gnu-parallel.html
5276 Thanks to Pavel Nuzhdin <pnzhdin at gmail dot com>
5278 * Web review http://psung.blogspot.com/2010/08/gnu-parallel.html
5279 Thanks to Phil Sung <psung at alum dot mit dot edu>
5284 * Arguments can now be given on the command line. Example:
5285 parallel bzip2 ::: *.txt
5287 * xapply like functionality. Example:
5288 parallel diff {1} {2} :::: filelist1 filelist2
5289 parallel diff {1} {2} ">"{1.}-{2.}.diff :::: filelist1 filelist2
5291 * Arch Linux package. Thanks to Peter Simons <simons at cryp dot to>
5293 * Mandriva package. Thanks to Sandro Cazzaniga <kharec at mandriva dot
5296 * -L -l -n -s now implies -X unless -m is set
5301 * New video showing the new options.
5302 http://www.youtube.com/watch?v=OpaiGYxkSuQ or at
5303 http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/
5305 * 100% options complete with xargs. All options for xargs can now be
5306 used in GNU Parallel - even the more exotic.
5308 * --basefile for transferring basedata. When running jobs on remote
5309 computers --basefile will transfer files before the first jobs is
5310 run. It can be used to transfer data that remains the same for each
5311 job such as scripts or lookup tables.
5313 * --progress shows progress. To see how many jobs is running on each
5314 server use --progress. It can be turned on even after GNU Parallel
5317 * --eta shows estimated time left in seconds.
5319 * --halt-on-error stops if an error occurs. GNU Parallel will default
5320 to run all jobs - even if some of them fail. With --halt-on-error
5321 GNU Parallel can ignore errors, wait for the currently running jobs
5322 to finish, or stop immediately when an error occurs.
5327 * GNU Parallel now has support for running jobs on remote machines
5329 * Intro video http://www.youtube.com/watch?v=LlXDtd_pRaY
5330 http://openvideo.dailymotion.com/video/xdmqwz_gnu-parallel-script-processing-and_tech
5335 * GNU Parallel is now official GNU software