3 * Invitation to the 10 years anniversary next year.
5 * Bug fixes and man page updates.
10 * SIGTERM is changed to SIGHUP, so sending SIGHUP will make GNU
11 Parallel start no more jobs, but wait for running jobs to finish.
13 * SIGTERM SIGTERM is changed to SIGTERM, so sending SIGTERM will make
14 GNU Parallel kill all running jobs.
16 * GNU Parallel now includes a cheat sheet: parallel_cheat.pdf
18 * High Throughput Computing on RMACC Summit and Beyond
19 https://calendar.colorado.edu/event/high_throughput_computing_on_rmacc_summit_and_beyond#.XH2NBhB7mV4
21 * GNU Parallel Cheat Sheet by cpriest
22 https://www.cheatography.com/cpriest/cheat-sheets/gnu-parallel/
24 * Use Multiple CPU Cores(Parallelize) with Single Threaded Linux
26 http://xensoft.com/use-multiple-cpu-cores-parallelize-with-single-threaded-linux-commands/
28 * Bug fixes and man page updates.
33 * --shard makes it possible to send input to a the same jobslot based
34 on the value in one column of the input. It is similar to sharding
37 * --shellquote --shellquote will shell quote the input twice.
39 * GNU Parallel is available in Termux
40 https://github.com/termux/termux-packages/tree/master/packages/parallel
42 * Linux, command line & MetaCentrum
43 https://trapa.cz/sites/default/files/linux_bash_metacentrum_course_4.pdf
45 * How to supercharge your bash workflows with GNU parallel
46 https://medium.freecodecamp.org/how-to-supercharge-your-bash-workflows-with-gnu-parallel-53aab0aea141
48 * GNU Parallel Spring 2017 https://www.youtube.com/watch?v=LHb29uW_KyI
50 * Parallelizing Freesurfer blog.cogneurostats.com/?p=148
52 * FreeSurfer #4: Running recon-all in Parallel https://www.youtube.com/watch?v=XHN2tm3tNaw
54 * FreeSurfer: recon-all https://www.neurotrivial.com/2019/01/24/freesurfer-recon-all/
56 * Come ridimensionare 10k foto con la riga di comando
57 https://pigrecoinfinito.wordpress.com/2018/12/22/come-ridimensionare-10k-foto-con-la-riga-di-comando/
59 * 并行处理 – Gnu Parallel:嵌套并行
60 https://codeday.me/bug/20190122/552902.html
62 * シェルスクリプトでコマンドを並列実行する方法
63 https://www.kwbtblog.com/entry/2019/01/12/020423
65 * Bug fixes and man page updates.
70 * 'env_parallel --end-session' makes it possible to nest 'env_parallel
73 * Using GNU Parallel in pentesting https://youtu.be/mZ0OUJmkIlA?t=873
75 * Supercomputer Workshop: Feb 1&7
76 http://www.ece.unm.edu/featured-students/supercomputer-workshop-feb-17.html
78 * Bug fixes and man page updates.
83 * Better /proc/cpuinfo parser.
85 * Simpler job scheduling flow.
87 * MPGI Workshop: Job Parallelization with Task Arrays and GNU Parallel
88 https://www.msi.umn.edu/tutorials/mpgi-workshop-module-4
90 * CONCOCT uses GNU Parallel
91 https://media.readthedocs.org/pdf/concoct/latest/concoct.pdf
93 * If you use SLURM read
94 https://wiki.hpc.uconn.edu/index.php/Advanced_SLURM
97 https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
99 * Bug fixes and man page updates.
104 * Experimental simpler job flow control.
106 * 時間がかかるコマンドを GNU parallel で 並列実行する
107 https://qiita.com//grohiro/items/4db3fa951a4778c5c479
109 * Bug fixes and man page updates.
114 * env_parallel.fish: --session support (alpha quality)
116 * GNU Parallel was cited in: High-throughput sequencing of murine
117 immunoglobulin heavy chain repertoires using single side unique
118 molecular identifiers on an Ion Torrent PGM
119 https://doi.org/10.18632/oncotarget.25493
121 * GNU parallel in Japanese Wikipedia
122 https://ja.wikipedia.org/wiki/GNU_parallel
124 * Outils de paramétrisation des tâches: lots de tâches, GNU Parallel
125 https://www.eventbrite.ca/e/inscription-outils-de-parametrisation-des-taches-lots-de-taches-gnu-parallel-et-bqtools-midi-conference-de-50271076142
127 * Bug fixes and man page updates.
132 * Minix is supported again.
134 * Updated graph showing GNU Parallel's overhead per job for each
135 version. https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
137 * Intro to Computing at CARC includes introduction to GNU Parallel
138 http://carc.unm.edu/education--training/workshops-and-seminars.html
140 * Fast-GBS uses GNU Parallel https://bitbucket.org/jerlar73/fast-gbs/wiki/Home
142 * Belgium at 10 m resolution in July 2018 http://www.cesbio.ups-tlse.fr/multitemp/?p=14116
144 * Bug fixes and man page updates.
149 * parset sets exit code.
151 * How to install GNU Parallel
152 https://www.techrepublic.com/videos/how-to-install-gnu-parallel/
154 * Bug fixes and man page updates.
159 * The quoting engine has been changed. Instead of using \-quoting GNU
160 Parallel now uses '-quoting in bash/ash/dash/ksh. This should
161 improve compatibility with different locales. This is a big change
162 causing this release to be alpha quality.
164 * The CPU calculation has changed. By default GNU Parallel uses the
165 number of CPU threads as the number of CPUs. This can be changed to
166 the number of CPU cores or number of CPU sockets with
167 --use-cores-instead-of-threads or --use-sockets-instead-of-threads.
169 * The detected number of sockets, cores, and threads can be shown with
170 --number-of-sockets, --number-of-cores, and --number-of-threads.
172 * env_parallel now support mksh using env_parallel.mksh.
174 * GNU Parallel is distributed as part of Snippy
175 https://github.com/tseemann/snippy
177 * GNU Parallel: Ejecutar comandos simultáneamente en Linux
178 https://esgeeks.com/gnu-parallel-ejecutar-comandos-simultaneo-linux/
180 * Parallel download genomic data with GNU-Parallel
181 https://digibio.blogspot.com/search/label/GNU-Parallel
183 * Bug fixes and man page updates.
188 * Deal better with multibyte chars by forcing LC_ALL=C.
190 * GNU Parallel was introduced in Pincount Podcast:
191 https://pincountpodcast.com/episodes/29.html
193 * GNU Parallel was shown on Danish national news for 1.7 seconds: dr.dk
195 * How to run Linux commands simultaneously with GNU Parallel
196 https://www.techrepublic.com/article/how-to-run-commands-simultaneously-with-gnu-parallel/#ftag=RSS56d97e7
198 * Easy parallelization with GNU parallel
199 http://mpharrigan.com/2016/08/02/parallel.html
201 * GNU Parallel for mutlithreaded tasks
202 http://slhogle.github.io/2016/gnu-parallel/
204 * A GNU Parallel Clustering Demo
205 https://www.crowdsupply.com/ground-electronics/circumference/updates/a-gnu-parallel-clustering-demo
207 * 使用 GNU Parallel 提高 Linux 命令行执行效率
208 https://linux.cn/article-9718-1.html
210 * Ejecutando tareas desde consola simultáneamente con GNU Parallel
211 https://poesiabinaria.net/2018/06/ejecutando-tareas-desde-consola-simultaneamente-gnu-parallel/
213 * Cómo ejecutar varias tareas simultáneamente en el terminal con GNU
215 https://www.ubuntizando.com/como-ejecutar-varias-tareas-simultaneamente-en-el-terminal-con-gnu-parallel/
217 * GNU Parallel 활용 가이드 http://genoglobe.kr/kribb/gnu_parallel
219 * Bug fixes and man page updates.
224 * --tty allows for more programs accessing /dev/tty in parallel. Some
225 programs require tty access without using it.
227 * env_parallel --session will record names in current environment in
228 $PARALLEL_IGNORED_NAMES and exit. It is only used with env_parallel,
229 and can work like --record-env but in a single session.
231 * 35 day course: Linux shell scripting and text processing for big
232 data https://comquest.in/training
234 * How To Use Your Entire CPU In Bash With Parallel
235 https://bash-prompt.net/guides/parallell-bash/
237 * An easy way to run parallel jobs on Stampede2
238 https://blog.uta.edu/xus/2017/09/29/an-easy-way-to-run-parallel-jobs-on-stampede2/
240 * Get more done at the Linux command line with GNU Parallel
241 https://opensource.com/article/18/5/gnu-parallel
243 * Save Time with Modern Search Techniques
244 https://www.sans.org/summit-archives/file/summit-archive-1524582079.pdf
246 * GNU Parallel: haz más cosas simultáneamente en el terminal
247 https://blog.desdelinux.net/gnu-parallel-haz-mas-cosas-simultaneamente-en-el-terminal/
249 * 「今日から使い切る」ための GNU Parallelによる並列処理入門
250 https://www.slideshare.net/koji_matsuda/gnu-parallel
252 * Bug fixes and man page updates.
257 * --csv makes GNU Parallel parse the input sources as CSV. When used
258 with --pipe it only passes full CSV-records.
260 * Time in --bar is printed as 1d02h03m04s.
262 * Optimization of --tee: It spawns a process less per value.
264 * The GNU Parallel 2018 book is now available:
265 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html
267 * Modern pentest tricks for faster, wider, greater engagement (15)
268 https://conference.hitb.org/hitbsecconf2018ams/materials/D1%20COMMSEC%20-%20Thomas%20Debize%20-%20Modern%20Pentest%20Tricks%20for%20Faster,%20Wider,%20Greater%20Engagements.pdf
270 * Running many serial jobs efficiently
271 https://userinfo.surfsara.nl/documentation/running-many-serial-jobs-efficiently
273 * GNU Parallel: как сохранить результаты нескольких команд для
274 переменной? http://fliplinux.com/gnu-parallel-6.html
276 * Running Multiple Commands in Parallel on a GNU Linux
277 https://www.youtube.com/watch?v=sHpTywpb4_4
279 * Klaatu covers the documentation of GNU parallel in episode 12x15
280 http://gnuworldorder.info/
282 * Bug fixes and man page updates.
287 * niceload -p can now take multiple pids separated by comma
289 * --timeout gives a warning when killing processes
291 * --embed now uses the same code for all supported shells
293 * --delay can now take arguments like 1h12m07s
295 * Parallel. Straight from your command line
296 https://medium.com/@alonisser/parallel-straight-from-your-command-line-feb6db8b6cee
298 * GNU Parallel was used in POAP-Parallelized Open Babel & Autodock
299 suite Pipeline https://github.com/inpacdb/POAP
301 * Pi Cluster Parallel Script First Fire
302 https://chiefio.wordpress.com/2018/02/23/pi-cluster-parallel-script-first-fire/
304 * How to Restore MySQL Logical Backup at Maximum Speed
305 https://www.percona.com/blog/2018/02/22/restore-mysql-logical-backup-maximum-speed/
307 * Bug fixes and man page updates.
312 * --embed makes it possible to embed GNU parallel in a shell
313 script. This is useful if you need to distribute your script to
314 someone who does not want to install GNU parallel.
316 * Parallelize Your Large Batches of Small Jobs
317 https://amito.me/2018/02/Parallelize-Your-Large-Batches-of-Small-Jobs/
319 * Klaatu expounds upon xargs and talks GNU parallel in episode 12x6
320 http://gnuworldorder.info/
322 * How to use parallel to speed up your work
323 https://mike42.me/blog/how-to-use-parallel-to-speed-up-your-work
325 * Transient compute clustering with GNU Parallel and sshfs
326 https://dennismungai.wordpress.com/2018/02/06/transient-compute-clustering-with-gnu-parallel-and-sshfs/
328 * Useful Examples of ffmpeg and GNU parallel on the command-line
329 https://dennismungai.wordpress.com/2018/02/06/useful-examples-of-ffmpeg-and-gnu-parallel-on-the-command-line/
331 * Data Science at the Command Line (Chapter 8.3)
332 https://www.datascienceatthecommandline.com/
334 * Bug fixes and man page updates.
339 * bash / 병렬 https://code.i-harness.com/ko/docs/bash/2a1a
341 * 15分钟神器gnu parallel 入门观止
342 http://www.ezilin.com/2018/01/15gnu-parallel.html
344 * How To Run Multiple Commands In Parallel on Linux
345 https://www.slashroot.in/how-run-multiple-commands-parallel-linux
347 * Bug fixes and man page updates.
352 * env_parset for ash, dash, ksh, sh, zsh
354 * Automatically create hostgroups if argument ends in @sshlogin
356 * Tips for running jobs on your VM
357 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
359 * Node-local scheduling
360 https://mogonwiki.zdv.uni-mainz.de/dokuwiki/node_local_scheduling
362 * GNU Parallel https://docs.computecanada.ca/wiki/GNU_Parallel
364 * GNU Parallel のエラー処理 https://qiita.com/inouet/items/bfc208668c86caf8ff74
367 https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
369 * Bug fixes and man page updates.
374 * Using GNU Parallel to speed up Google Cloud Infrastructure
376 https://medium.com/@pczarkowski/using-gnu-parallel-to-speed-up-google-cloud-infrastructure-management-53e5c555ec05
378 * What is gnu parallel
379 http://wiki.chpc.ac.za/howto:bioinformatics:gnu-parallel
381 * Parallel, Scripts, Clusters, & Easy Use
382 https://chiefio.wordpress.com/2017/11/10/parallel-scripts-clusters-easy-use/
384 * Bug fixes and man page updates.
389 * Initial support for XDG Base Directory $XDG_* environment variables.
391 * Validating half a million TIFF files. Part
393 https://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
395 * Turing data science class: Cluster computing
396 https://www.turing.ac.uk/events/masterclass-cluster-computing/
398 * Butlin:Unix for Bioinformatics - advanced tutorial
399 https://openwetware.org/wiki/Butlin:Unix_for_Bioinformatics_-_advanced_tutorial
401 * พยายามใช้ CPU ให้ครบทุก CORE
402 https://veer66.wordpress.com/2017/09/02/use-multi-core/
404 * Examples on using GNU Parallel
405 https://gist.github.com/drmalex07/de8ff1379a560f6d84a0d863e60ae378
407 * Bug fixes and man page updates.
412 * Use '--limit myprog' to make a dynamic job limit. Just return 0 to
413 spawn another job, 1 to not spawn another job, and 2 to kill the
416 * PARALLEL_RSYNC_OPTS and --rsync-opts sets the options for rsync
419 * Download all of humble bundle books in parallel
420 https://til.hashrocket.com/posts/ggt1jaes4y-download-all-of-humble-bundle-books-in-parallel
422 * Bug fixes and man page updates.
427 * --line-buffer no longer uses tempfiles. This is faster and makes it
428 possible for a single process to output more data than there is free
431 * Vote for GNU Parallel's community ads on
432 http://meta.unix.stackexchange.com/a/4356/2972
433 http://meta.askubuntu.com/a/16750/22307
434 http://meta.serverfault.com/a/9040/45704
436 * Edit images with GNU Parallel and ImageMagick
437 https://fedoramagazine.org/edit-images-parallel-imagemagick/
439 * Running Bash Commands in Parallel
440 https://dzone.com/articles/running-bash-commands-in-parallel-1
442 * Today I Learned: GNU parallel, plate tectonics
443 https://medium.com/@nornagon/today-i-learned-gnu-parallel-plate-tectonics-9fcf24045e63
445 * GNU Parallel Tutorial
446 https://www.upf.edu/web/sct-sit/gnu-parallel-tutorial
448 * Validating half a million TIFF files
449 http://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
451 * Blender and GNU Parallel
452 https://www.blendernation.com/2017/08/16/blender-gnu-parallel/
454 * Quick Introduction to GNU Parallel
455 https://github.com/LangilleLab/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel
457 * A simple distributed animation render example using GNU Parallel
458 https://gitlab.com/skororu/scripts
460 * Do stuff on things, in parallel
461 http://blogs.fluidinfo.com/terry/2017/08/05/do-stuff-on-things-in-parallel/
463 * Bash And GNU Parallel NGS Bidniz
464 http://ino.pm/outreach/presentations/2014/03/genomics-wranglers/index.html
466 * Using for loop vs Gnu parallel for BLAST
467 http://www.ettemalab.org/using-for-loop-vs-gnu-parallel-for-blast/
469 * 并行rsync https://gxnotes.com/article/175866.html
471 * Bug fixes and man page updates.
476 * Vote for GNU Parallel's community ads on
477 http://meta.unix.stackexchange.com/a/4356/2972
478 http://meta.askubuntu.com/a/16750/22307
479 http://meta.serverfault.com/a/9040/45704
481 * GNU Parallel was cited in: Hayabusa: Simple and Fast Full-Text
482 Search Engine for Massive System Log Data
483 http://dl.acm.org/citation.cfm?id=3095788
485 * コマンドの並列化を行える『GNU parallel』の個人的使い方まとめ
486 https://orebibou.com/2017/07/%E3%82%B3%E3%83%9E%E3%83%B3%E3%83%89%E3%81%AE%E4%B8%A6%E5%88%97%E5%8C%96%E3%82%92%E8%A1%8C%E3%81%88%E3%82%8B%E3%80%8Egnu-parallel%E3%80%8F%E3%81%AE%E5%80%8B%E4%BA%BA%E7%9A%84%E4%BD%BF%E3%81%84/
488 * How to play and play with thousands of digitized 78rpm records
489 https://blog.archive.org/2017/07/10/how-to-play-and-play-with-78rpm-record-transfers/
491 * 并行一个for循环 https://gxnotes.com/article/130363.html
493 * RFC 8142: GeoJSON Text Sequences
494 https://sgillies.net/2017/05/18/rfc-8142-geojson-text-sequences.html
496 * Git auto fetch script I run every day
497 https://lukas.zapletalovi.com/2017/07/git-auto-fetch-script-i-run-every-day.html
499 * cores, cpus and threads
500 http://crazyhottommy.blogspot.de/2017/07/cores-cpus-and-threads.html
502 * Bug fixes and man page updates.
507 * The command line can now contain \257 (Macron) or UTF characters
510 * Vote for GNU Parallel's community ads on
511 http://meta.unix.stackexchange.com/a/4356/2972
512 http://meta.askubuntu.com/a/16750/22307
513 http://meta.serverfault.com/a/9040/45704
515 * Graph for overhead for 1000 jobs has been updated. It remains
516 steadily at 3.5 ms per job on a 1.7 GHz machine
517 https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
519 * GNU Parallel was cited in: The topology of the directed clique
520 complex as a network invariant
521 https://springerplus.springeropen.com/articles/10.1186/s40064-016-2022-y
523 * GNU Parallel was cited in: Improving Optical Character Recognition
524 of Finnish Historical Newspapers with a Combination of Fraktur &
525 Antiqua Models and Image
526 http://www.ep.liu.se/ecp/131/038/ecp17131038.pdf
528 * GNU Parallel was cited in: Parallel Execution of Structural Mechanic
529 Tasks with Use of Small Supercomputers
530 http://www.sciencedirect.com/science/article/pii/S1877705817324815
532 * GNU Parallel was cited in: Integration of a Multilingual Preordering
533 Component into a Commercial SMT Platform
534 https://www.degruyter.com/downloadpdf/j/pralin.2017.108.issue-1/pralin-2017-0009/pralin-2017-0009.pdf
536 * Tips For Running Jobs On Your VM
537 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
539 * Speed up ML model development with GNU Parallel
540 https://pzelasko.github.io/posts/speed-up-ml-model-development-with-gnu-parallel
542 * Parallelizing a Python Function for the Extremely Lazy
543 http://tdhopper.com/blog/2017/Jun/07/parallelizing-a-python-function-for-the-extremely-lazy/
546 http://www.android5.online/Android/androidjc/androidkf/gykf/201603/8741.html
548 * Bug fixes and man page updates.
553 * --timeout can now use s=second,m=minute,h=hour,d=day.
555 * --dr is now an alias for --dry-run.
557 * Vote for GNU Parallel's community ads on
558 http://meta.unix.stackexchange.com/a/4356/2972
559 http://meta.askubuntu.com/a/16750/22307
560 http://meta.serverfault.com/a/9040/45704
562 * GNU Parallel was cited in: Feature Detection in Visual Cortex during
563 Different Functional States
564 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5397493/
566 * GNU Parallel was cited in: From genotype to phenotype: inferring
567 relationships between microbial traits and genomic components
568 https://docserv.uni-duesseldorf.de/servlets/DerivateServlet/Derivate-44622/main.pdf
570 * GNU Parallel was cited in: Designing fecal microbiota transplant
571 trials that account for differences in donor stool efficacy
572 http://biorxiv.org/content/biorxiv/early/2016/07/25/065383.full.pdf
574 * GNU Parallel was cited in: Assessing the predictability of
575 anharmonic vibrational modes at the example of hydroxyl groups - ad
576 hoc construction of localised modes and the influence of structural
577 solute–solvent motifs
578 http://pubs.rsc.org/-/content/articlelanding/2017/cp/c7cp01662j#!divAbstract
580 * GNU Parallel was cited in: Mapping Environmental Influences on
582 ftp://frapftp.fire.ca.gov/outgoing/transfer/PUC_Map1/Utility%20Fire%20map%201%20final%20review%20and%20development%20report21616.pdf
584 * GNU Parallel was cited in: Weak vs. Strong Disorder Superfluid-Bose
585 Glass Transition in One Dimension
586 https://arxiv.org/pdf/1704.02257.pdf
588 * GNU Parallel was cited in: Online Automatic Post-editing for MT in a
589 Multi-Domain Translation Environment
590 https://www.aclweb.org/anthology/E/E17/E17-1050.pdf
592 * GNU Parallel was cited in: Cross-calibration of S-NPP VIIRS
593 moderate-resolution reflective solar bands against MODIS Aqua over
595 http://www.atmos-meas-tech.net/10/1425/2017/amt-10-1425-2017.pdf
597 * GNU Parallel was cited in: Scattering Networks: Efficient 2D
598 Implementation And Application To Melanoma Classification
599 http://amslaurea.unibo.it/12261/1/nurrito_eugenio_tesi_fisica_magistrale.pdf
601 * GNU Parallel was cited in: Genome-scale detection of positive
602 selection in 9 primates predicts human-virus evolutionary conflicts
603 http://biorxiv.org/content/biorxiv/early/2017/04/27/131680.full.pdf
605 * GNU Parallel is used in: Creates a speech dataset for deep learning
606 https://github.com/jupiter126/Create_Speech_Dataset
608 * GNU Parallel is used in: Parse and process the demixing secrets
609 dataset (DSD100) https://github.com/faroit/dsdtools
611 * First glance at the gnu parallel utility
612 https://ibiscybernetics.com/blog/2017-04-05.html
614 * Installing parallel from source
615 https://bitsanddragons.wordpress.com/2017/05/03/installing-parallel-from-source/
617 * How to run command or code in parallel in bash shell under Linux or
619 https://www.cyberciti.biz/faq/how-to-run-command-or-code-in-parallel-in-bash-shell-under-linux-or-unix/
621 * Parallel Serial Jobs Using GNU Parallel
622 http://www.hpc.lsu.edu/training/weekly-materials/2017-Spring/gnuparallel-Feb2017.pdf
624 * GNU Parallel or How to list millions of S3 objects
625 https://joeray.me/gnu-parallel-how-to-list-millions-objects.html
627 * Which Is the Best Tool for Copying a Large Directory Tree Locally?
628 http://arjon.es/2017/05/11/which-is-the-best-tool-for-copying-a-large-directory-tree-locally/
630 * Bug fixes and man page updates.
635 * --halt supports done in addition to success and fail.
637 * parset will set variables in parallel in Bash.
639 * Perl 5.6 on Irix is no longer supported.
641 * Vote for GNU Parallel's community ads on
642 http://meta.unix.stackexchange.com/a/4356/2972
643 http://meta.askubuntu.com/a/16750/22307
644 http://meta.serverfault.com/a/9040/45704
646 * GNU Parallel was cited in: Halvade-RNA: Parallel variant calling
647 from transcriptomic data using MapReduce
648 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0174575
650 * GNU Parallel was cited in: StrAuto: automation and parallelization
651 of STRUCTURE analysis
652 http://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-017-1593-0
654 * GNU Parallel was cited in: Trespassing the Boundaries: Labeling
655 Temporal Bounds for Object Interactions in Egocentric Video
656 https://128.84.21.199/pdf/1703.09026.pdf
658 * GNU Parallel is used in: https://github.com/lucascbeyeler/zmbackup
661 https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
663 * Find and xargs and parallel
664 http://helpful.knobs-dials.com/index.php/Find_and_xargs_and_parallel#Parallel
666 * Quick Introduction to GNU Parallel
667 https://github.com/mlangill/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel
669 * Data science at the command line https://www.slideshare.net/sharatsc/data-science-at-the-command-line
671 * Bedtools笔记 http://www.jianshu.com/p/67b0665490ac
673 * Bug fixes and man page updates.
678 * --rpl can now take arguments by adding '(regexp)' in the replacement
681 * Vote for GNU Parallel's community ads on
682 http://meta.unix.stackexchange.com/a/4356/2972
683 http://meta.askubuntu.com/a/16750/22307
684 http://meta.serverfault.com/a/9040/45704
686 * GNU Parallel was cited in: shmlast: An improved implementation of
687 Conditional Reciprocal Best Hits with LAST and Python
688 https://joss.theoj.org/papers/3cde54de7dfbcada7c0fc04f569b36c7
690 * GNU Parallel was cited in: Prediction of relativistic electron flux
691 in the Earth’s outer radiation belt at geostationary orbit by
693 https://link.springer.com/article/10.1134/S0016793217010108
695 * GNU Parallel was cited in: Higher likelihood of multiple bit-flips
696 due to neutron-induced strikes on logic gates
697 https://arxiv.org/pdf/1612.08239.pdf
699 * GNU Parallel was cited in: A Monte Carlo Resampling Approach for the
700 Calculation of Hybrid Classical and Quantum Free Energies
701 http://pubs.acs.org/doi/pdfplus/10.1021/acs.jctc.6b00506
703 * GNU Parallel was cited in: Learning string distance with smoothing
704 for OCR spelling correction
705 https://link.springer.com/article/10.1007/s11042-016-4185-5
707 * GNU Parallel was cited in: The Breakdown of String Perturbation
708 Theory for Many External Particles
709 https://arxiv.org/pdf/1611.08003.pdf
711 * GNU Parallel was cited in: Operations Research Applications in
713 https://dspace.library.colostate.edu/bitstream/handle/11124/170687/Johnson_mines_0052E_11207.pdf?sequence=1&isAllowed=y
715 * GNU Parallel was cited in: Parallel Computing: GNU Parallel
716 http://www.blopig.com/blog/2017/02/parallel-computing-gnu-parallel/
718 * Stig Sandbeck Mathisen: Change All The Passwords (Again)
719 http://garf.us/2017/02/stig-sandbeck-mathisen-change-all-the-passwords-again/
721 * Trabalhando como Paralelismo no Bash usando o GNU Parallel
722 http://www.beyeler.com.br/2017/03/trabalhando-como-paralelismo-no-bash-usando-o-gnu-parallel/
724 * GNU parallel と SQL*Loader 組み合わせ実行例
725 https://blogs.oracle.com/LetTheSunShineIn/entry/gnu_parallel_%E3%81%A8_sql_loader
727 * Bug fixes and man page updates.
732 * env_parallel now supports /bin/sh, ash, dash.
734 * --tee will pipe all data to all jobs. Used with --pipe/--pipepart
735 and :::. Small example: seq 3333 | parallel --pipe --tee --tag 'grep
736 {} | wc -l' ::: {0..9}
738 * If --results {replstr} ends in /: save in dir. Otherwise save as
739 file. Example: parallel --results {} echo {} ::: a b c
741 * Vote for GNU Parallel's community ads on
742 http://meta.unix.stackexchange.com/a/4356/2972
743 http://meta.askubuntu.com/a/16750/22307
744 http://meta.serverfault.com/a/9040/45704
746 * GNU Parallel was cited in: Low-delay forwarding with multiple
747 candidates for VANETs using multi-criteria decision making
748 http://ieeexplore.ieee.org/document/7835961/
750 * GNU Parallel was cited in: An Integrated Simulator and Dataset that
751 Combines Grasping and Vision for Deep Learning
752 https://arxiv.org/pdf/1702.02103.pdf
754 * GNU Parallel was cited in: A Bayesian model selection approach for
755 identifying differentially expressed transcripts from RNA sequencing
756 data http://onlinelibrary.wiley.com/doi/10.1111/rssc.12213/full
758 * GNU Parallel was cited in: The impact of copy number variation on
759 gout, and the apple genome
760 https://ourarchive.otago.ac.nz/bitstream/handle/10523/7060/BoocockJames2016MSc.pdf?sequence=3
762 * GNU Parallel was cited in: Reaction rates for reaction-diffusion
763 kinetics on unstructured meshes
764 http://aip.scitation.org/doi/10.1063/1.4975167
766 * GNU Parallel was cited in: Modeling prediction error improves power
767 of transcriptome-wide association studies
768 http://biorxiv.org/content/biorxiv/early/2017/02/14/108316.full.pdf
770 * GNU Parallel was cited in: Proper experimental design requires
771 randomization/balancing of molecular ecology experiments
772 http://biorxiv.org/content/biorxiv/early/2017/02/17/109280.full.pdf
774 * GNU Parallel was cited in: Experiment-based thermal micromagnetic
775 simulations of the magnetization reversal for ns-range clocked
777 http://aip.scitation.org/doi/full/10.1063/1.4974021
779 * GNU Parallel was cited in: The University of Edinburgh’s systems
780 submission to the MT task at IWSLT
781 http://workshop2016.iwslt.org/downloads/IWSLT_2016_paper_27.pdf
783 * Fast-GBS uses GNU Parallel: https://bitbucket.org/jerlar73/fast-gbs
785 * Job: DevOps Engineer/Senior Systems Administrator in New York, New
787 http://rockefeller.jobs/new-york-ny/devops-engineersenior-systems-administrator/2DB3408EAC9E4617AD238550F31C7641/job/
789 * Training in GNU Parallel:
790 https://www.carc.unm.edu/education-outreach/workshops--training/
792 * Training in GNU Parallel:
793 http://www.hpc.lsu.edu/training/registration.php?topic=Parallel%20Serial%20Jobs%20Using%20GNU%20Parallel&date=February%2022,%202017&time=9:00%20AM%20-%2011:00%20AM&place=307%20Frey&deadline=2017-02-21%2016:30:00
795 * Batch Convert Images from PNG to JPEG
796 http://coreygoldberg.blogspot.dk/2017/02/batch-convert-images-from-png-to-jpeg.html
798 * Accelerating Oxford Nanopore Basecalling
799 http://fowlerlab.org/2017/01/26/accelerating-oxford-nanopore-basecalling/
801 * parallel и imagemagick в loop на bash
802 https://www.linux.org.ru/forum/development/13190247
804 * Bug fixes and man page updates.
814 * sql now uses a temporary credentials file for MySQL to avoid
817 * --sqlmaster and --sqlworker have been reworked.
819 * --sqlworker only reads from the DBURL: any command and any arguments
822 * --sqlmaster +DBURL will append different commands to the DBURL and
825 * If --results contain a replacement string, no tree structure with
826 args will be generated.
828 * --fg --tmux or --fg --tmuxpane will connect to the tmux.
830 * GNU Parallel was cited in: Fast, Automated Indoor Light Detection,
831 Classification, and Measurement
832 https://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-212.pdf
834 * GNU Parallel was cited in: Unbiased RNA Shotgun Metagenomics in
835 Social and Solitary Wild Bees Detects Associations with Eukaryote
836 Parasites and New Viruses
837 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0168456
839 * GNU Parallel was cited in: Almost Event-Rate Independent Monitoring
840 of Metric Temporal Logic
841 http://people.inf.ethz.ch/trayteld/papers/tacas17-aerial/aerial.pdf
843 * 使用GNU parallel命令并行预处理数据: https://blog.razrlele.com/p/1843
845 * GNU Parallel as a queuing system:
846 http://puntoblogspot.blogspot.com/2017/01/gnu-parallel-as-queuing-system.html
848 * AWS re:Invent 2016: Deep Dive on Amazon Elastic File System (STG202)
850 http://www.slideshare.net/AmazonWebServices/aws-reinvent-2016-deep-dive-on-amazon-elastic-file-system-stg202
851 and https://youtu.be/PlTuJx4VnGw?t=30m16s
853 * Bug fixes and man page updates.
858 * --results foo.csv will save output as a CSV-file. Can be directly
859 imported into R or LibreCalc.
861 * When using --pipepart a negative --block-size is not interpreted as
862 a block size but as the number of blocks each jobslot should have.
864 * --sqlmaster/--sqlandworker will append jobs to the DBURL if the
865 DBURL is prepended with +.
867 * GNU Parallel was cited in: A cloud-based workflow to quantify
868 transcript-expression levels in public cancer compendia
869 http://www.nature.com/articles/srep39259
871 * GNU Parallel was cited in: Determination of crystal structures of
872 proteins of unknown identity using a marathon molecular replacement
873 procedure: Structure of Stenotrophomonas maltophilia
874 phosphate-binding protein
875 https://www.researchgate.net/publication/308186413_Determination_of_crystal_structures_of_proteins_of_unknown_identity_using_a_marathon_molecular_replacement_procedure_Structure_of_Stenotrophomonas_maltophilia_phosphate-binding_protein
877 * GNU Parallel was cited in: Large-scale benchmarking reveals false
878 discoveries and count transformation sensitivity in 16S rRNA gene
879 amplicon data analysis methods used in microbiome studies
880 http://microbiomejournal.biomedcentral.com/articles/10.1186/s40168-016-0208-8
882 * GNU Parallel was cited in: Decomposing Images into Layers via
884 https://cs.gmu.edu/~ygingold/singleimage/Decomposing%20Images%20into%20Layers%20via%20RGB-space%20Geometry%20(Tan%20et%20al%202016%20TOG)%20small.pdf
886 * Transient compute clustering with GNU Parallel and sshfs
887 https://gist.github.com/Brainiarc7/24c966c8a001061ee86cc4bc05826bf4
889 * 4 Ways to Batch Convert Your PNG to JPG and Vice-Versa
890 http://www.tecmint.com/linux-image-conversion-tools/
892 * All's Fair in Love and Distributed Storage
893 http://cohesity.com/blog/alls-fair-love-distributed-storage/
895 * How can I use GNU Parallel to run a lot of commands in parallel
896 https://www.msi.umn.edu/support/faq/how-can-i-use-gnu-parallel-run-lot-commands-parallel
898 * 정해영의 블로그 - JEONG Haeyoung's blog
899 http://blog.genoglobe.com/2016/11/gnu-parallel.html
901 * 在Linux下将PNG和JPG批量互转的四种方法
902 http://os.51cto.com/art/201612/524182.htm
904 * Running in parallel http://tomkimpson.com/howto/gnuparallel/
906 * Taco Bell Parallel Programming
907 https://giorgos.sealabs.net/taco-bell-parallel-programming.html
909 * Bug fixes and man page updates.
914 * --record-env can now be used with env_parallel for bash, ksh, pdksh,
917 * GNU Parallel was cited in: An improved implementation of Conditional
918 Reciprocal Best Hits with LAST and Python
919 https://pypi.python.org/pypi/shmlast/1.0.3
921 * GNU Parallel was cited in: miRPathDB: a new dictionary on microRNAs
923 http://nar.oxfordjournals.org/content/early/2016/10/13/nar.gkw926.full
925 * GNU/Parallel – Run multiple commands simultaneously
926 https://vinusumi.wordpress.com/2016/11/08/gnuparallel-run-multiple-commands-simultaneously/
928 * Tutorial: Parallel web scraping with CasperJS and GNU Parallel
929 http://g-liu.com/blog/2016/10/tutorial-parallel-web-scraping-with-casperjs-and-gnu-parallel/
931 * Bug fixes and man page updates.
936 * First command no longer gets stdin as it causes unpredictable issues.
938 * GNU Parallel was cited in: Efficiently parallelized modeling of
939 tightly focused, large bandwidth laser pulses
940 https://arxiv.org/pdf/1609.08146v1.pdf
942 * How to crunch lots of geodata in parallel
943 http://blog.faraday.io/how-to-crunch-lots-of-geodata-in-parallel/
945 * GNU parallel is my new toaster
946 http://amedee.me/gnu-parallel-is-my-new-toaster/index.html
948 * Bug fixes and man page updates.
953 * parcat - cat files or fifos in parallel
955 * GNU Parallel was cited in: Velocity: A Netflow Based Optimized
957 https://mospace.umsystem.edu/xmlui/bitstream/handle/10355/50842/Thesis_2016_Pakhare.pdf?sequence=1&isAllowed=y
959 * GNU Parallel was cited in: Viral deep sequencing needs an adaptive
960 approach: IRMA, the iterative refinement meta-assembler
961 http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5011931/
963 * Using GNU Parallel and ImageMagick for Conversions
964 https://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
966 * Training in GNU Parallel
967 http://www.cism.ucl.ac.be/Services/Formations/parcomp.pdf
969 * Chown Ceph OSD data directory using GNU Parallel
970 http://blog.widodh.nl/2016/08/chown-ceph-osd-data-directory-using-gnu-parallel/
972 * FastGBS uses GNU Parallel https://bitbucket.org/jerlar73/fastgbs
974 * dDocent: A guide to ddRAD sequencing
975 https://ddocent.wordpress.com/ddocent-pipeline-user-guide/
977 * SOFTWARE GNU Parallel
978 http://msi-riss.readthedocs.io/en/latest/software/gnu-parallel.html
980 * Bug fixes and man page updates.
985 * --tmuxpane opens jobs in panes in tmux. Useful if you want to
986 monitor progress of less than 100 simultaneous jobs.
988 * --linebuffer now treats \r as line ending, too.
990 * Perl changes forces use of floats to be given with leading zero, so
993 * --xapply renamed to --link.
995 * Support for pdksh will fade until someone packages it for Ubuntu 16.
997 * GNU Parallel was cited in: Exome sequencing of geographically
998 diverse barley landraces and wild relatives gives insights into
999 environmental adaptation
1000 http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3612.html?WT.feed_name=subjects_genetics#references
1002 * GNU Parallel was cited in: Vision-Enhanced Lidar Odometry and
1003 Mapping https://www.ri.cmu.edu/pub_files/2016/8/DLL-thesis.pdf
1005 * Easy parallelization with GNU parallel
1006 http://mpharrigan.com/2016/08/02/parallel.html
1008 * Facebook V: Predicting Check Ins, Winner's Interview: 2nd Place,
1010 http://blog.kaggle.com/2016/08/02/facebook-v-predicting-check-ins-winners-interview-2nd-place-markus-kliegl/
1013 http://www.manitou-mail.org/blog/2016/07/parallel-import/
1015 * Large file batch processing using NodeJs and GNU Parallel
1016 http://www.zacorndorff.com/2016/07/27/large-file-batch-processing-using-nodejs-and-gnu-parallel/
1018 * Bug fixes and man page updates.
1023 * env_parallel is now ready for wider testing. It is still beta
1026 * env_parallel is heavily modified for all shells and testing has been
1029 * Selectively choosing what to export using --env now works for
1030 env_parallel (bash, csh, fish, ksh, pdksh, tcsh, zsh).
1032 * --round-robin now gives more work to a job that processes faster
1033 instead of same amount to all jobs.
1035 * --pipepart works on block devices on GNU/Linux.
1037 * GNU Parallel was cited in: HybPiper: Extracting Coding Sequence and
1038 Introns for Phylogenetics from High-Throughput Sequencing Reads
1039 Using Target Enrichment
1040 http://www.bioone.org/doi/full/10.3732/apps.1600016
1042 * GNU Parallel was cited in: StrAuto - Automation and Parallelization
1043 of STRUCTURE Analysis
1044 http://www.crypticlineage.net/download/strauto/strauto_doc.pdf
1046 * GNU Parallel was cited in: Tools and techniques for computational
1048 http://gigascience.biomedcentral.com/articles/10.1186/s13742-016-0135-4
1050 * GNU Parallel was cited in: FlashPCA: fast sparse canonical
1051 correlation analysis of genomic data
1052 http://biorxiv.org/content/biorxiv/suppl/2016/04/06/047217.DC1/047217-1.pdf
1054 * GNU Parallel was cited in: Math Indexer and Searcher under the Hood:
1055 Fine-tuning Query Expansion and Unification Strategies
1056 http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings12/pdf/ntcir/MathIR/05-NTCIR12-MathIR-RuzickaM.pdf
1058 * GNU Parallel was cited in: The Evolution and Fate of
1059 Super-Chandrasekhar Mass White Dwarf Merger Remnants
1060 http://arxiv.org/pdf/1606.02300.pdf
1062 * GNU Parallel was cited in: Evaluation of Coastal Scatterometer
1064 https://mdc.coaps.fsu.edu/scatterometry/meeting/docs/2016/Thu_AM/coastal-poster.pdf
1066 * GNU Parallel was used in: https://github.com/splitice/bulkdnsblcheck
1068 * The iconv slurp misfeature
1069 http://www.openfusion.net/linux/iconv_slurp_misfeature
1071 * แบบว่า CPU เหลือ https://veer66.wordpress.com/2016/06/15/gnu-parallel/
1073 * Bug fixes and man page updates.
1078 * $PATH can now be exported using --env PATH. Useful if GNU Parallel
1079 is not in your path on remote machines.
1081 * If --block is left out, --pipepart will use a block size that will
1082 result in 10 jobs per jobslot.
1084 * The cookie from 2016-01-04 was won by Morgan Rodgers on the
1085 2016-06-06 after 5 months.
1087 * Vote for GNU Parallel's community ad on
1088 https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
1090 * GNU Parallel was cited in: Genotypic Resistance Tests Sequences
1091 Reveal the Role of Marginalized Populations in HIV-1 Transmission in
1092 Switzerland http://www.nature.com/articles/srep27580
1094 * GNU Parallel was cited in: A Deep-Learning Approach for Operation of
1095 an Automated Realtime Flare Forecast
1096 https://arxiv.org/pdf/1606.01587.pdf
1098 * Unix parallel: Populating all the USB sticks
1099 http://www.markhneedham.com/blog/2016/06/01/unix-parallel-populating-all-the-usb-sticks/
1101 * GNU Parallel is a fantastic utility https://www.dray.be/parallel/
1103 * Combining a large number of VCF files
1104 https://gtamazian.com/2016/06/16/combining-a-large-number-of-vcf-files/
1106 * Useful Scraping Techniques
1107 http://blog.apps.npr.org/2016/06/17/scraping-tips.html
1109 * Tools of the trade
1110 http://onox.com.br/2015/05/tools-of-the-trade/#more-198
1112 * Armslist scraper https://github.com/nprapps/armslist-scraper/
1114 * Bug fixes and man page updates.
1119 * niceload --net pauses the program if the internet connection is
1122 * Vote for GNU Parallel's community ad on
1123 https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
1125 * Updated speed comparison between versions
1126 https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
1128 * GNU Parallel was cited in: Improving computation efficiency by
1129 parallel programming
1130 http://www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?C21COM=2&I21DBN=UJRN&P21DBN=UJRN&IMAGE_FILE_DOWNLOAD=1&Image_file_name=PDF/ape_2013_3_44.pdf
1132 * GNU Parallel was cited in: A supernova feedback implementation for
1133 the astrophysical simulation software Arepo
1134 https://arxiv.org/abs/1604.06071
1136 * GNU Parallel was cited in: Lorenz-Mie theory for 2D scattering and
1137 resonance calculations https://arxiv.org/pdf/1505.07691v2.pdf
1139 * GNU Parallel was cited in: Host-pathogen co-evolution and the
1140 emergence of broadly neutralizing antibodies in chronic infections
1141 https://arxiv.org/abs/1512.06296
1143 * GNU Parallel was cited in: Pacific People, Metabolic Disease and
1144 Evolutionary Processes: a mitochondrial DNA study
1145 https://otago.ourarchive.ac.nz/handle/10523/6340
1147 * GNU Parallel was cited in: The effect of domain modeling on
1148 efficiency of planning: Lessons from the Nomystery domain
1149 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7407131
1151 * GNU Parallel was cited in: Oops, my tests broke the build: An
1152 analysis of Travis CI builds with GitHub
1153 https://peerj.com/preprints/1984/
1155 * GNU Parallel was cited in: Drosophila Muller F Elements Maintain a
1156 Distinct Set of Genomic Properties Over 40 Million Years of
1157 Evolution http://www.g3journal.org/content/5/5/719.full.pdf+html
1159 * GNU Parallel was cited in: An Empirical Comparison of Neural
1160 Architectures for Reinforcement Learning in Partially Observable
1162 http://biorxiv.org/content/biorxiv/early/2016/03/24/022707.full.pdf
1164 * GNU Parallel was cited in: PleaseTM: Enabling Transaction Conflict
1165 Management in Requester-wins Hardware Transactional Memory
1166 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7446072
1168 * GNU Parallel was cited in: EASE-MM: Sequence-Based Prediction of
1169 Mutation-Induced Stability Changes with Feature-Based Multiple
1171 http://www.sciencedirect.com/science/article/pii/S0022283616000310
1173 * GNU Parallel was cited in: A new orthology assessment method for
1174 phylogenomic data: Unrooted Phylogenetic Orthology
1175 http://mbe.oxfordjournals.org/content/early/2016/04/06/molbev.msw069.short
1176 https://github.com/ballesterus/UPhO
1178 * GNU Parallel was cited in: Distinctive Interest Point Selection for
1179 Efficient Near-duplicate Image Retrieval
1180 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7459172
1182 * GNU Parallel was cited in: The Evolution of C Programming Practices:
1183 A Study of the Unix Operating System 1973–2015
1184 https://dl.acm.org/citation.cfm?id=2884799 (It has the cutest
1185 thumbnail graphs I have ever seen scattered all over the text)
1187 * GNU Parallel was cited in: Data processing pipeline for serial
1188 femtosecond crystallography at SACLA
1189 http://journals.iucr.org/j/issues/2016/03/00/zw5001/index.html
1191 * GNU Parallel was cited in: Reconstruction of Fine-Scale Auroral
1192 Dynamics http://arxiv.org/pdf/1512.01460.pdf
1194 * GNU Parallel was cited in: Genomic legacy of the African cheetah,
1196 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4676127/pdf/13059_2015_Article_837.pdf
1198 * GNU Parallel was cited in: Don’t Forget to Lock the Back Door! A
1199 Characterization of IPv6 Network Security Policy
1200 http://benign-research-probe2.eecs.umich.edu/ndss16_ipv6_final.pdf
1202 * GNU Parallel was cited in: Comprehensive Annotation of the
1203 Parastagonospora nodorum Reference Genome Using Next-Generation
1204 Genomics, Transcriptomics and Proteogenomics
1205 http://journals.plos.org/plosone/article/asset?id=10.1371%2Fjournal.pone.0147221.PDF
1207 * GNU Parallel was cited in: How attention influences perceptual
1208 decision making: Single-trial EEG correlates of drift-diffusion
1209 model parameters http://www.cidlab.com/prints/nunez2016attention.pdf
1211 * GNU Parallel was cited in: Telomere And Proximal Sequence Analysis
1212 Using High-Throughput Sequencing Reads
1213 http://repository.upenn.edu/edissertations/1460/
1215 * GNU Parallel was cited in: AT-GIS: Highly Parallel Spatial Query
1216 Processing with Associative Transducers
1217 http://lsds.doc.ic.ac.uk/sites/default/files/ATGIS-SIGMOD16.pdf
1219 * GNU Parallel was cited in: PVAIR: Partial Variable Assignment
1220 InterpolatoR http://verify.inf.usi.ch/sites/default/files/main-2.pdf
1222 * GNU Parallel was cited in: Comparative Cladistics: Fossils,
1223 Morphological Data Partitions and Lost Branches in the Fossil Tree
1224 of Life http://opus.bath.ac.uk/43955/
1226 * GNU Parallel was cited in: Shannon: An Information-Optimal de
1227 NovoRNA-Seq Assembler
1228 http://biorxiv.org/content/biorxiv/early/2016/02/09/039230.full.pdf
1230 * GNU Parallel was cited in: Adaptive Measure-Theoretic Parameter
1231 Estimation for Coastal Ocean Modeling
1232 https://repositories.lib.utexas.edu/handle/2152/32435
1234 * GNU Parallel was cited in: Computational Design of DNA-Binding
1236 http://link.springer.com/protocol/10.1007/978-1-4939-3569-7_16
1238 * GNU Parallel was cited in: Reference genotype and exome data from an
1239 Australian Aboriginal population for health-based research
1240 http://www.nature.com/articles/sdata201623
1242 * GNU Parallel was cited in: Do aye-ayes echolocate?
1243 http://biorxiv.org/content/biorxiv/early/2016/04/11/048165.full.pdf
1245 * GNU Parallel was cited in: Functional enrichments of disease
1246 variants across thousands of independent loci in eight diseases
1247 http://biorxiv.org/content/biorxiv/early/2016/04/11/048066.full.pdf
1249 * GNU Parallel was cited in: From genomes to phenotypes: Traitar, the
1250 microbial trait analyzer
1251 http://biorxiv.org/content/biorxiv/early/2016/03/12/043315.full.pdf
1253 * GNU Parallel was mentioned in: Fast Playback Framework for Analysis
1254 of Ground-Based Doppler Radar Observations Using MapReduce
1256 http://journals.ametsoc.org/doi/pdf/10.1175/JTECH-D-15-0118.1
1258 * NCBI blast tutorial
1259 https://github.com/enormandeau/ncbi_blast_tutorial
1261 * Distributed Preservation Made Simple
1262 https://blog.archive.org/2016/02/26/distributed-preservation-made-simple/
1264 * Parallel Jobs in Luigi http://rjbaxley.com/posts/2016/03/13/parallel_jobs_in_luigi.html
1266 * Bug fixes and man page updates.
1271 * :::+ and ::::+ work like ::: and :::: but links this input source to
1272 the previous input source in a --xapply fashion. Contrary to
1273 --xapply values do not wrap: The shortest input source determines
1276 * --line-buffer --keep-order now outputs continously from the oldest
1277 job still running. This is more what you would expect than the
1278 earlier behaviour where --keep-order had no effect with
1281 * env_parallel supports tcsh, csh, pdksh. In fish it now supports
1282 arrays. In csh/tcsh it now supports variables, aliases, and arrays
1283 with no special chars. In pdksh it supports aliases, functions,
1284 variables, and arrays.
1286 * Function exporting on Mac OS X works around old Bash version.
1288 * Better CPU detection on OpenIndiana.
1290 * GNU Parallel was cited in: Automatic Methods for Assisted
1292 https://www.researchgate.net/publication/297738658_Automatic_Methods_for_Assisted_Recruitment
1294 * GNU Parallel was cited in: Reinterpretation of ATLAS 8 TeV searches
1295 for Natural SUSY with a R-Sneutrino LSP
1296 http://arxiv.org/pdf/1603.06130.pdf
1298 * GNU Parallel was cited in: An Operational Radiometric Landsat
1299 Preprocessing Framework for Large-Area Time Series Applications
1300 https://www.uni-trier.de/fileadmin/fb6/prof/FER/Publikationen/frantz_et_al_ieee-tgrs-2016-post-print.pdf
1302 * A basic demo of how GNU Parallel can speed up execution of commands
1303 https://www.youtube.com/watch?v=kl8LO2jcvMc
1305 * qbatch uses GNU Parallel: https://pypi.python.org/pypi/qbatch/1.0rc2
1307 * FaceCrop uses GNU Parallel: https://github.com/EderSantana/FaceCrop
1309 * Parallel Processing with Catmandu
1310 https://librecatproject.wordpress.com/2016/04/20/parallel-processing-with-catmandu/
1313 http://staypython.blogspot.dk/2016/04/gnu-parallel.html
1315 * Bug fixes and man page updates.
1320 * env_parallel is a function that exports the environment (functions,
1321 aliases, variables, and arrays) to GNU Parallel. Run 'man
1322 env_parallel' for details.
1324 * niceload --prg now searches for substrings if no process with the
1327 * GNU Parallel was cited in: Random Forest DBSCAN for USPTO Inventor
1328 Name Disambiguation http://arxiv.org/pdf/1602.01792.pdf
1330 * GNU Parallel was mentioned (with wrong citation) in: Dual Level
1331 Parallel Computations for LargeScale High-Fidelity Database to
1332 Design Aerospace Vehicles
1333 http://www.nas.nasa.gov/assets/pdf/papers/Guruswamy_2013_DualLevelParallelComputations.pdf
1335 * Using ‘Parallel’ in Unix
1336 https://shearnrylan.wordpress.com/2016/02/22/using-parallel-in-unix/
1338 * JPEG Squish uses (and co-distributes) GNU Parallel:
1339 http://dantidswell.co.uk/jpeg-squish/
1341 * Bug fixes and man page updates.
1346 * Vote for new community on Superuser, Ask Ubuntu, Unix&Linux
1347 http://meta.superuser.com/questions/11127/community-promotion-ads-2016/11225#11225
1348 http://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
1349 http://meta.unix.stackexchange.com/questions/3854/community-promotion-ads-2016/3893#3893
1351 * Daily Quick Tip: parallel
1352 https://medium.com/@jacaetevha/daily-quick-tip-parallel-8772435f6582
1354 * Downloading a list of URLs
1355 http://blog.gypsydave5.com/2016/02/04/xargs-and-curl/
1357 * Using GNU Parallel and ImageMagick for Conversions
1358 http://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
1360 * Running bash commands in parallel
1361 http://linuxcommando.blogspot.dk/2016/01/running-bash-commands-in-parallel.html
1363 * parallel processing in PDAL
1364 https://smathermather.wordpress.com/2016/01/28/parallel-processing-in-pdal/
1366 * A Million Text Files And A Single Laptop
1367 http://randyzwitch.com/gnu-parallel-medium-data/
1369 * 「今日から使い切る」ための GNU Parallelによる並列処理入門
1370 http://www.slideshare.net/koji_matsuda/gnu-parallel
1372 * Bug fixes and man page updates.
1377 * --sql DBURL uses DBURL as storage for jobs and output. It does not
1378 run any jobs so it requires at least one --sqlworker. DBURL must
1381 * --sqlworker DBURL gets jobs from DBURL and stores the result back to
1384 * --sqlandworker is a shorthand for --sql and --sqlworker.
1386 * --sqlworker requires the output of a single job to fit in memory.
1388 * --results now also saves a file called 'seq' containing the sequence
1391 * If $PARALLEL_ENV is a file, then that file will be read into
1394 * man parallel_tutorial has been given an overhaul.
1396 * --workdir now accepts replacementstrings.
1398 * GNU Parallel was cited in: Possum - A Framework for
1399 Three-Dimensional Reconstruction of Brain Images from Serial
1400 Sections http://link.springer.com/article/10.1007/s12021-015-9286-1
1402 * GNU Parallel was cited in: A Genetic Algorithm for the selection of
1403 structural MRI features for classification of Mild Cognitive
1404 Impairment and Alzheimer's Disease
1405 http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=7359909&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7359909
1407 * GNU Parallel was cited in: The Effect of Domain Modeling on
1408 Performance of Planning Algorithms
1409 http://isaim2016.cs.virginia.edu/papers/ISAIM2016_Bartak_Vodrazka.pdf
1411 * Plotting time tables for jobs run by GNU Parallel
1412 https://github.com/ziotom78/plot_joblog
1414 * GNU Parallel was used in: Mission Impossible: you have 1 minute to
1415 analyze the Ebola Genome https://www.biostars.org/p/119397
1417 * GNU Parallel is used in LAST: http://last.cbrc.jp/
1419 * Distributed Log Search Using GNU Parallel
1420 http://codehate.com/blog/2015/12/01/distributed-log-search-using-gnu-parallel/
1422 * Bug fixes and man page updates.
1427 * --transfer is now an alias for --transferfile {}.
1429 * --transferfile works like --transfer, but takes an argument like
1430 --return. This makes it possible to combine transferring files
1431 with multiple input sources: parallel -S server --tf {1} wc {2}
1432 {1} ::: * ::: -l -w -c
1434 * total_jobs() can now be used in {= =}: parallel echo job {#} of '{=
1435 $_=total_jobs() =}' ::: {1..50}
1437 * GNU Parallel was cited in: Evolution and Learning in Heterogeneous
1439 http://research.gold.ac.uk/15078/1/COM_thesis_JonesD_2015.pdf
1441 * GNU Parallel was cited in: Achieving Consistent Doppler Measurements
1442 from SDO/HMI Vector Field Inversions
1443 http://arxiv.org/pdf/1511.06500.pdf
1445 * Flo uses GNU Parallel: https://github.com/wurmlab/flo
1447 * 使用 GNU parallel 來平行運算
1448 http://mutolisp.logdown.com/posts/316959-using-gnu-parallel-to-parallel-computing
1450 * Bug fixes and man page updates.
1455 * GNU Parallel packaged for CERN CentOS:
1456 http://linuxsoft.cern.ch/cern/centos/7/cern/x86_64/repoview/parallel.html
1458 * GNU Parallel was cited in: The Outer Solar System Origins Survey:
1459 I. Design and First-Quarter Discoveries
1460 http://arxiv.org/pdf/1511.02895.pdf
1462 * GNU Parallel was cited in: Contrasting genetic architectures of
1463 schizophrenia and other complex diseases using fast
1464 variance-components analysis
1465 http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3431.html
1467 * GNU Parallel was cited in: Named-Entity Chunking for Norwegian Text
1468 using Support Vector Machines
1469 http://ojs.bibsys.no/index.php/NIK/article/viewFile/248/211
1471 * GNU Parallel was cited in: Multiscale Estimation of Binding Kinetics
1472 Using Brownian Dynamics, Molecular Dynamics and Milestoning
1473 http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004381#pcbi.1004381.ref072
1475 * GNU Parallel was cited in: A Detailed Characterization of Errors in
1476 Logic Circuits due to Single-Event Transients
1477 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=7302348&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7302348
1479 * GNU Parallel was cited in: Arabic Speaker Emotion Classification
1480 Using Rhythm Metrics and Neural Networks
1481 http://www.eurasip.org/Proceedings/Eusipco/Eusipco2015/papers/1570104855.pdf
1483 * GNU Parallel was cited in: Stride Search: a general algorithm for
1484 storm detection in high resolution climate data
1485 http://www.geosci-model-dev-discuss.net/8/7727/2015/gmdd-8-7727-2015.pdf
1487 * GNU Parallel was cited in: Decomposing Digital Paintings into Layers
1488 via RGB-space Geometry http://arxiv.org/pdf/1509.03335.pdf
1490 * GNU Parallel was cited in: Structure and evolutionary history of a
1491 large family of NLR proteins in the zebrafish
1492 http://www.biorxiv.org/content/biorxiv/early/2015/09/18/027151.full.pdf
1494 * GNU Parallel was cited in: Evolution of movement strategies under
1495 competitive interactions
1496 http://digital.csic.es/bitstream/10261/115973/1/evolution_movement_strategies_Kiziridis.pdf
1498 * Automating large numbers of tasks
1499 https://rcc.uchicago.edu/docs/tutorials/kicp-tutorials/running-jobs.html
1501 * Max out your IOPs with GNU Parallel
1502 http://blog.bitratchet.com/2015/11/11/max-out-your-iops-with-gnu-parallel/
1504 * Bug fixes and man page updates.
1509 * --plus makes it possible to use {##} as a shorthand for
1510 {= $_=$Global::JobQueue->total_jobs() =} which gives the the number
1511 of jobs to run in total.
1513 * {= $_=$Global::JobQueue->total_jobs() =} is incompatible with -X,
1516 * GNU Parallel is now mostly compatible with lsh
1517 (http://www.lysator.liu.se/~nisse/lsh/) and somewhat compatible with
1518 autossh (http://www.harding.motd.ca/autossh/).
1520 * --workdir ... now also works when run locally.
1522 * GNU Parallel was cited in: There is no (75, 32, 10, 16) strongly
1523 regular graph http://arxiv.org/pdf/1509.05933.pdf
1525 * GNU Parallel was cited in: Roary: rapid large-scale prokaryote pan
1527 http://bioinformatics.oxfordjournals.org/content/early/2015/08/05/bioinformatics.btv421.full.pdf+html
1529 * GNU Parallel is used in TraitAR:
1530 https://testpypi.python.org/pypi/traitar/0.1.4
1532 * A parallel and fast way to download multiple files
1533 http://onetipperday.blogspot.com/2015/10/a-parallel-and-fast-way-to-download.html
1535 * Usar GNU Parallel para aumentar el rendimiento de tus scripts
1536 http://adrianarroyocalle.github.io/blog/2015/10/20/usar-gnu-parallel/
1538 * Bug fixes and man page updates.
1543 * GNU Parallel was cited in: Flexible Modeling of Epidemics with an
1544 Empirical Bayes Framework
1545 http://journals.plos.org/ploscompbiol/article?id=10.1371%2Fjournal.pcbi.1004382
1547 * GNU Parallel was cited in: BL1: 2D Potts Model with a Twist
1548 https://sucs.swan.ac.uk/~rjames93/Dissertation.pdf
1550 * GNU Parallel was cited in: A Scalable Parallel Implementation of
1551 Evolutionary Algorithms for Multi-Objective Optimization on GPUs
1552 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7257074
1554 * GNU Parallel was cited in: How Can We Measure the Similarity Between
1555 Résumés of Selected Candidates for a Job?
1556 https://www.researchgate.net/publication/275954089_How_can_we_measure_the_similarity_between_rsums_of_selected_candidates_for_a_job
1558 * GNU Parallel was cited in: Interplay of cell dynamics and epithelial
1559 tension during morphogenesis of the Drosophila pupal wing
1560 http://www.researchgate.net/profile/Raphael_Etournay/publication/279061859_Interplay_of_cell_dynamics_and_epithelial_tension_during_morphogenesis_of_the_Drosophila_pupal_wing/links/558a95ad08aeae8413bcceea.pdf
1562 * Third-party selling GNU Parallel T-shirts
1563 http://www.aliexpress.com/item/2015F-BSO-GNU-LOGO-GNU-PARALLEL-men-s-shirt-sleeve-visual-illusion-error/32464827966.html
1565 * Joys of gnu parallel
1566 http://scottolesen.com/index.php/2015/08/26/joys-of-gnu-parallel/
1568 * Crop and resize images with bash and ImageMagick
1569 https://www.simonholywell.com/post/2015/08/image-resize-crop-bash-imagemagick/
1571 * Three Ways to Script Processes in Parallel
1572 http://www.codeword.xyz/2015/09/02/three-ways-to-script-processes-in-parallel/
1574 * What It Looks Like to Process 3.5 Million Books
1575 http://blog.gdeltproject.org/what-it-looks-like-to-process-3-5-million-books/
1577 * Bug fixes and man page updates.
1582 * If $job->skip() is called in {= =} the job will not be run.
1584 * @arg can now be used in {= =}: parallel echo '{= $arg[2] < 5 and
1585 $_="j" =}' ::: 1 2 3 ::: 4 5 6
1587 * Version of GNU Parallel that uses PostgreSQL as backend
1588 https://github.com/stephen-fralich/parallel-sql/
1590 * SpeedSeq: ultra-fast personal genome analysis and interpretation
1591 http://www.nature.com/nmeth/journal/vaop/ncurrent/full/nmeth.3505.html
1593 * GNU Parallel is used in elPrep: https://github.com/ExaScience/elprep
1595 * Who actually reads the code?
1596 http://www.fsf.org/blogs/community/who-actually-reads-the-code
1598 * Introduction to GNU Parallel
1599 http://erictleung.com/2015/08/06/intro-to-gnu-parallel/
1601 * ¿Alguien se lee el código?
1602 http://www.taringa.net/post/linux/18854759/Alguien-se-lee-el-codigo.html
1604 * ¿Quién se lee el código fuente?
1605 https://victorhckinthefreeworld.wordpress.com/2015/08/12/quien-se-lee-el-codigo-fuente/
1607 * Distribution des traitements avec GNU Parallel
1608 http://blog.inovia-conseil.fr/?p=226#4
1610 * Эксперимент по проверке, читают ли код открытых проектов
1611 http://www.opennet.ru/opennews/art.shtml?num=42718
1613 * 多核心主機搭配 GNU parallel
1614 http://blog.zeroplex.tw/2015/08/gnu-parallel.html
1616 * Bug fixes and man page updates.
1621 * If a record fits in a block, --block only reads upto the size of
1622 --block. If not: --block reads a full --block more.
1624 * Due to widely spread distributions still using --tollef even after a
1625 year of being retired following a year of being obsolete, --tollef
1626 now gives an error unless used with --gnu.
1628 * --nice now uses a perl wrapper instead of the nice command.
1630 * Cookie 2013-08-18 was won by Mark Maimone, 1 year and 11 months
1633 * A parser for GNU Parallel --joblog files:
1634 https://github.com/harryjubb/joblog
1636 * GNU Parallel was cited in: Dynamical formation & scattering of
1637 hierarchical triples: Cross sections, Kozai-Lidov oscillations, and
1638 collisions http://arxiv.org/pdf/1507.03593.pdf
1640 * GNU Parallel was cited in: A Fast Compiler for NetKAT
1641 http://arxiv.org/pdf/1506.06378.pdf
1643 * GNU Parallel was cited in: Decomposing Time-Lapse Paintings into
1645 http://cs.gmu.edu/~ygingold/timemap/Decomposing%20Time-Lapse%20Paintings%20into%20Layers%20(Tan%20et%20al%202015%20SIGGRAPH)%20600dpi.pdf
1647 * GNU Parallel was used in: Somatic mutation calling from the matched
1648 tumor-normal exome-sequencing
1649 http://fafner.meb.ki.se/biostatwiki/somac/
1651 * Parallel Processing from the Command Line
1652 https://www.perpetual-beta.org/weblog/parallel-processing-from-the-command-line.html
1654 * Using GNU Parallel to speed up network operations
1655 http://vielmetti.typepad.com/vacuum/2015/06/using-gnu-parallel-to-speed-up-network-operations.html
1657 * Crawl faster with "parallel" - but how fast?
1658 http://andreas-wpv.blogspot.com/2015/07/crawl-faster-with-parallel-but-how-fast.html
1660 * Simultaneously benchmark many URLs with ApacheBench and GNU parallel
1661 https://www.simonholywell.com/post/2015/06/parallel-benchmark-many-urls-with-apachebench/
1663 * Bug fixes and man page updates.
1668 * --halt has been rewritten completely. You can now combine
1669 percentages with success or fail. See the man page.
1671 * Exit values 102..254 have been removed. 101 means more than 100 jobs
1674 * Killing through --timeout, --memfree, or --halt is now done as a
1677 * --termseq determines which signals are sent when a job is killed.
1679 * An empty argument would previously cause no string to be
1680 inserted. This is now changed to '' being inserted, thus prepending
1681 a space to the output of: parallel echo {} b ::: ''
1683 * $PARALLEL_ENV can now be set to an environment prepending the
1684 command. Used in env_parallel as mentioned in the manpage.
1686 * --retry-failed will retry all failed jobs in a joblog. It will
1687 ignore any command given.
1689 * --ssh and $PARALLEL_SSH can be used to set the command used for
1690 ssh. The command is assumed to behave the same way as ssh.
1692 * --fifo now works in csh, too.
1694 * Q(...) can be used in {= =} to shell quote a string.
1696 * GNU Parallel was cited in: DockBench: An Integrated Informatic
1697 Platform Bridging the Gap between the Robust Validation of Docking
1698 Protocols and Virtual Screening Simulations
1699 http://www.mdpi.com/1420-3049/20/6/9977
1701 * GNU Parallel was cited in: Swedes Online: You Are More Tracked Than
1703 http://www.diva-portal.org/smash/get/diva2:807623/FULLTEXT01.pdf
1705 * GNU Parallel was cited in: Tutorial: Lorenz-Mie theory for 2D
1706 scattering and resonance calculations
1707 http://arxiv.org/pdf/1505.07691.pdf
1709 * GNU Parallel was cited in: A quantitative assessment of the Hadoop
1710 framework for analyzing massively parallel DNA sequencing data
1711 http://link.springer.com/article/10.1186/s13742-015-0058-5
1713 * GNU Parallel was cited in: A composite genome approach to identify
1714 phylogenetically informative data from next-generation sequencing
1715 http://www.biomedcentral.com/content/pdf/s12859-015-0632-y.pdf
1717 * GNU Parallel is used in: taxator-tk
1718 http://algbio.cs.uni-duesseldorf.de/webapps/wa-download/
1720 * GNU Parallel is used in: https://github.com/d2207197/local-mapreduce
1722 * GNU Parallel is used in: wiki-edit-news https://github.com/albert-decatur/wiki-edit-news
1724 * GNU Parallel is used in: A Fingerprint Identification System
1725 https://curve.carleton.ca/system/files/theses/28733.pdf
1727 * Job ad asking for GNU Parallel experience:
1728 http://searchjobs.intel.com/gdansk-pol/software-validation-engineer/63A06826DAF24797AB414DC146201C2E/job/
1730 * Using BLAT http://wangzhengyuan.blogspot.dk/2015/06/using-blat.html
1732 * Bug fixes and man page updates.
1737 * Security: The security issue for --sshlogin + --fifo/--cat has been
1738 fixed. Thereby all issues with
1739 http://lists.gnu.org/archive/html/parallel/2015-04/msg00045.html
1742 * Security: After further security analysis the issue fixed in
1743 20150422 also fixed the problem for --tmux.
1745 * GNU Parallel was cited in: CIDER: a pipeline for detecting waves of
1746 coordinated transcriptional regulation in gene expression
1748 http://biorxiv.org/content/biorxiv/early/2015/03/17/012518.full.pdf
1750 * GNU Parallel was cited in: Building Genomic Analysis Pipelines in a
1751 Hackathon Setting with Bioinformatician Teams: DNA-seq, Epigenomics,
1752 Metagenomics and RNA-seq
1753 http://biorxiv.org/content/biorxiv/early/2015/05/05/018085.full.pdf
1755 * GNU Parallel was cited in: Sequencing the cap-snatching repertoire
1756 of H1N1 influenza provides insight into the mechanism of viral
1757 transcription initiation
1758 http://nar.oxfordjournals.org/content/early/2015/04/20/nar.gkv333.full.pdf
1760 * GNU Parallel was cited in: Genome assembly using Nanopore-guided
1761 long and error-free DNA reads
1762 http://www.biomedcentral.com/content/pdf/s12864-015-1519-z.pdf
1764 * GNU Parallel was used (unfortunately with wrong citation) in:
1765 Comparing the CarbonTracker and TM5-4DVar data assimilation systems
1766 for CO2 surface flux inversions
1767 http://www.atmos-chem-phys-discuss.net/15/8883/2015/acpd-15-8883-2015-discussion.html
1769 * GNU Parallel was used in: Gene Set Omic Analysis (GSOA) method
1770 https://bitbucket.org/srp33/gsoa
1772 * A Quick and Neat :) Orchestrator using GNU Parallel
1773 http://www.elsotanillo.net/2015/05/a-quick-and-neat-orchestrator-using-gnu-parallel/
1775 * Execute commands on multiple computers using GNU Parallel (setting
1776 up a cluster on the cheap)
1777 https://spectraldifferences.wordpress.com/2015/04/26/execute-commands-on-multiple-computers-using-gnu-parallel-setting-up-a-cluster-on-the-cheap/
1779 * Functions and GNU parallel for effective cluster load management
1780 http://genomespot.blogspot.dk/2015/04/functions-and-gnu-parallel-for.html
1782 * Use parallel processing to save time importing databases
1783 http://drupalsun.com/node/41854
1785 * Run multiple ssh commands in parallel with GNU Parallel
1786 http://www.ameir.net/blog/archives/380-run-multiple-ssh-commands-in-parallel-with-gnu-parallel.html
1788 * Importing huge databases faster
1789 https://www.lullabot.com/blog/article/importing-huge-databases-faster
1791 * Parallel? Gnu parallel! https://debian.pro/1834
1793 * Bug fixes and man page updates.
1798 New in this release:
1800 * Security fix. An attacker on the local system could make you
1801 overwrite one of your own files with a single byte. The problem
1802 exist when you use --compress or --tmux or --pipe or --cat or
1803 --fifo. The attacker must figure out the randomly chosen file name
1804 and create a symlink within a time window of 15 ms.
1806 * --shuf will generate all jobs, and shuffle them before running
1807 them. This is useful to get a quick preview of the results before
1808 running the full batch.
1810 * GNU Parallel now has a DOI: https://dx.doi.org/10.5281/zenodo.16303
1812 * GNU Parallel was cited in: Scaling Machine Learning for Target
1813 Prediction in Drug Discovery using Apache Spark
1814 https://cris.cumulus.vub.ac.be/portal/files/5147244/spark.pdf
1816 * GNU Parallel was cited in: Bayesian inference of protein structure
1817 from chemical shift data https://peerj.com/articles/861/
1819 * GNU Parallel was cited in: Toward Enhanced Metadata Quality of
1820 Large-Scale Digital Libraries: Estimating Volume Time Range
1821 https://www.ideals.illinois.edu/bitstream/handle/2142/73656/186_ready.pdf
1823 * GNU Parallel was cited in: Experimental study on the Wind Farm
1824 Substation Cable Installation Problem
1825 http://i11www.iti.uni-karlsruhe.de/_media/teaching/theses/ma-schmitz-14.pdf
1827 * GNU Parallel was used in: https://github.com/KAPPS-/landsat-gifworks
1829 * GNU Parallel was used in: https://github.com/exascience/elprep
1831 * GNU Parallel was used in:
1832 http://search.cpan.org/~jillrowe/HPC-Runner-GnuParallel-0.01/
1834 * GNU Parallel was used in:
1835 http://search.cpan.org/~ajpage/Bio-Roary-2.0.7/lib/Bio/Roary/JobRunner/Parallel.pm
1837 * GNU Parallel was used in: Rapid haploid SNP calling
1838 https://github.com/tseemann/snippy
1840 * Pictures and Metadata
1841 http://www.ozzy.no/2015/02/05/pictures-and-metadata/
1843 * Task automation with bash and parallel
1844 https://biowize.wordpress.com/2015/03/23/task-automation-with-bash-and-parallel/
1846 * How To: Speed Up File Transfers in Linux using RSync with GNU
1848 http://www.yourownlinux.com/2015/04/speed-up-file-transfers-using-rsync-with-gnu-parallel.html
1850 * Mirroring a Git Repository
1851 https://avacariu.me/articles/mirroring-a-git-repository.html
1853 * Add an ENVI header to JAXA Global Mangrove Watch PALSAR tiles
1854 https://spectraldifferences.wordpress.com/2015/03/24/add-an-envi-header-to-jaxa-global-mangrove-watch-palsar-tiles/
1857 http://www.zhihu.com/question/29257300
1859 * Bug fixes and man page updates.
1864 New in this release:
1866 * --number-of-cores respects 'taskset' on GNU/Linux.
1868 * --joblog --pipe gives the data send and received in the log.
1870 * GNU Parallel was tested to support 100 GB sized records in --pipe. A
1871 few bugs was fixed to support >2 GB records. It works, but is rather
1874 * GNU Parallel was cited in: RIG: Recalibration and Interrelation of
1875 genomic sequence data with the GATK
1876 http://www.g3journal.org/content/early/2015/02/13/g3.115.017012.full.pdf+html
1878 * GNU Parallel was cited in: MPI-blastn and NCBI-TaxCollector:
1879 Improving metagenomic analysis with high performance classification
1880 and wide taxonomic attachment
1881 http://www.worldscientific.com/doi/abs/10.1142/S0219720014500139?af=R&
1883 * GNU Parallel was cited in: Recent evolution in Rattus norvegicus is
1884 shaped by declining effective population size
1885 http://biorxiv.org/content/biorxiv/early/2015/03/01/015818.full.pdf
1887 * GNU Parallel was cited in: Evidence for DCO+ as a probe of
1888 ionization in the warm disk surface
1889 http://arxiv.org/pdf/1503.02659.pdf
1891 * GNU Parallel was cited in: De novo assembly and annotation of the
1892 Asian tiger mosquito (Aedes albopictus) repeatome with dnaPipeTE
1893 from raw genomic reads and comparative analysis with the yellow
1894 fever mosquito (Aedes aegypti)
1895 http://gbe.oxfordjournals.org/content/early/2015/03/11/gbe.evv050.full.pdf
1897 * GNU Parallel was cited in: A General Approach to Network
1898 Configuration Analysis
1899 http://research.microsoft.com/en-us/um/people/ratul/papers/nsdi2015-batfish.pdf
1901 * GNU Parallel was cited in: Scrimer: designing primers from
1903 http://onlinelibrary.wiley.com/doi/10.1111/1755-0998.12403/pdf
1905 * GNU Parallel was cited in: Efficient Retrieval of Key Material for
1906 Inspecting Potentially Malicious Traffic in the Cloud
1907 http://sacko.uk/pdf/2015.1.pdf
1909 * GNU Parallel will be presented at Strataconf: Poor Man's Parallel
1911 http://strataconf.com/big-data-conference-uk-2015/public/schedule/detail/40031
1913 * GNU Parallel was used in:
1914 https://github.com/alexbyrnes/FCC-Political-Ads_The-Code
1916 * GNU Parallel was used in: https://github.com/martymac/fpart
1918 * GNU Parallel was used in:
1919 https://github.com/hoytak/diabetic-retinopathy-code
1921 * GNU Parallel was used in:
1922 https://github.com/mehmattski/HybSeqPipeline
1924 * GNU Parallel was used in:
1925 http://search.cpan.org/~ajpage/Bio-Roary-2.0.0/lib/Bio/Roary/JobRunner/Parallel.pm
1927 * Using GNU Parallel on a Raspberry Pi cluster:
1928 http://www.dcglug.org.uk/cluster-progress/
1930 * An introduction to vector tiling and map reduce in postgis:
1931 http://dimensionaledge.com/intro-vector-tiling-map-reduce-postgis/
1933 * Running scripts in parallel with GNU Parallel:
1934 http://code.jasonbhill.com/2015/03/
1936 * Mahout: Parallelising the creation of DecisionTrees:
1937 http://www.markhneedham.com/blog/2012/12/27/mahout-parallelising-the-creation-of-decisiontrees/
1939 * High-Performance Scientific Computing: Running serial jobs in
1941 https://support.scinet.utoronto.ca/education/staticpublic/course178/serial.pdf
1943 * Parallel cardinality on your laptop
1944 https://highonscience.wordpress.com/2015/03/15/parallel-cardinality-on-your-laptop/
1946 * Experiments about a better locate using grep
1947 http://a3nm.net/blog/better_locate.html
1949 * Homework with GNU Parallel:
1950 https://support.scinet.utoronto.ca/education/staticpublic/course178content349.html
1952 * Parallel - Jobs in Skripten parallelisieren:
1953 https://slzm.de/blog/linux-tool-des-tages-parallel-jobs-in-skripten-parallelisieren/#more-612
1955 * GNU Parallel, czyli 100% użycia procesora
1956 http://matmatyk.blogspot.dk/2015/03/gnu-parallel-czyli-100-uzycia-procesora.html
1958 * Bug fixes and man page updates.
1963 * --tmux has gotten a major overhaul.
1965 * GNU Parallel was cited in: RaftLib: A C++ Template Library for High
1966 Performance Stream Parallel Processing
1967 http://www.cs.wustl.edu/~lip/pubs/pmam15_jbeard.pdf
1969 * GNU Parallel was cited in: Quantifying properties of hot and dense
1970 QCD matter through systematic model-to-data comparison
1971 http://arxiv.org/pdf/1502.00339.pdf
1973 * GNU Parallel was cited in: Towards Collaborative Exploration and
1974 Analysis of Big Data from Mars: A Noachis Terra Case Study
1975 http://link.springer.com/chapter/10.1007/978-3-319-13865-7_25
1977 * GNU Parallel was used (unfortunately with wrong citation) in:
1978 Performance and Scaling Comparison Study of RDBMS and NoSQL
1980 http://ijact.in/wp-content/uploads/2014/11/COMPUSOFT-311-1270-1275.pdf
1982 * GNU Parallel was used (unfortunately without citation) in: Parallel
1983 Implementation of Big Data Pre-Processing Algorithms for Sentiment
1984 Analysis of Social Networking Data
1985 http://www.researchmathsci.org/IJFMAart/ijfma-v6n2-7.pdf
1987 * GNU Parallel was used (unfortunately without citation) in: SpeedSeq:
1988 Ultra-fast personal genome analysis and interpretation
1989 http://biorxiv.org/content/biorxiv/early/2014/12/05/012179.full.pdf
1991 * Zip Folders with GNU Parallel
1992 http://fazky.github.io/posts/Linux/2015-01-07-GNU-Parallel.html
1994 * Using GNU Parallel with Freesurfer
1995 http://programminginadarkroom.blogspot.dk/2015/02/using-gnu-parallel-with-freesurfer.html
1997 * GNU Parallel is used in Velociraptor: https://github.com/ericwhyne/Velociraptor
1999 * Marcus Beach GNU Parallel http://marcusbeach.co/gnu-parallel/
2001 * Bug fixes and man page updates.
2006 * Remote jobs now send stderr (standard error) to stderr (standard
2007 error) instead of stdout (standard output).
2009 * Remote execution command is now packed using base64 encoded
2010 bzip2. This means that big environments (app. 100 KB) can be
2011 transferred. This change makes remote execution alpha quality.
2013 * --semaphoretimeout now takes a negative value. This means give up if
2014 the semaphore is not gotten within the timeout.
2016 * --halt -1 and -2 now means halt if a job succeeds (so the opposite
2019 * --no-keep-order will reverse --keep-order.
2021 * Bash's second fix of shellshock caused --env to break again when
2022 exporting functions. This has been fixed again.
2024 * A semibig refactoring of big functions. All non-trivial functions
2025 are now less than 100 lines. The refactoring makes this release beta
2028 * A description of the design decisions for GNU Parallel can be found
2029 in 'man parallel_design'.
2031 * A bug fix in replacement strings caused rewrite of the replacement
2032 function. This makes use of replacement strings alpha quality.
2034 * GNU Parallel was cited in: Improving Energy and Performance with
2035 Spintronics Caches in Multicore Systems
2036 http://link.springer.com/chapter/10.1007/978-3-319-14313-2_24
2038 * GNU Parallel was cited in: Parallel post-processing with MPI-Bash
2039 http://dl.acm.org/citation.cfm?id=2691137
2041 * GNU Parallel was cited in: Distinguishing cause from effect using
2042 observational data: methods and benchmarks
2043 http://arxiv-web3.library.cornell.edu/pdf/1412.3773.pdf
2045 * GNU Parallel was cited in: Data Science at the Command Line
2046 http://cdn.oreillystatic.com/oreilly/booksamplers/9781491947852_sampler.pdf
2048 * GNU Parallel was cited in: Resolution of Genetic Map Expansion
2049 Caused by Excess Heterozygosity in Plant Recombinant Inbred
2050 Populations http://www.g3journal.org/content/4/10/1963.full.pdf
2052 * GNU Parallel was cited in: Bayesian Inference of Protein Structure
2053 from Chemical Shift Data https://peerj.com/preprints/692v1.pdf
2055 * GNU Parallel was cited in: Clonal interference and Mullerʼs ratchet
2056 in spatial habitats http://iopscience.iop.org/1478-3975/11/5/056003
2058 * GNU Parallel was cited in: Computação Verde na Camada de Aplicação
2059 https://linux.ime.usp.br/~tpaiva/mac0499/files/monografia.pdf
2061 * GNU Parallel was cited in: Frameshift alignment: statistics and
2062 post-genomic applications
2063 http://bioinformatics.oxfordjournals.org/content/30/24/3575.full.pdf+html
2065 * GNU Parallel was cited in: Towards Recommender Engineering Tools and
2066 Experiments for Identifying Recommender Differences
2067 http://elehack.net/research/thesis/mde-thesis.pdf
2069 * GNU Parallel was cited in: Speaker Environment Classification Using
2070 Rhythm Metrics in Levantine Arabic Dialect
2071 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6923918
2073 * GNU Parallel was cited in: A Formal Proof Of The Kepler Conjecture
2074 http://arxiv.org/pdf/1501.02155.pdf
2076 * GNU Parallel was cited in: Allocation Policy Analysis for Cache
2077 Coherence Protocols for STT-MRAM-based caches
2078 http://conservancy.umn.edu/bitstream/handle/11299/169362/Nandkar_umn_0130M_15551.pdf
2080 * GNU Parallel was cited in: Using Trusted Platform Module for
2081 securing virtual environment access in Cloud
2082 http://dar.aucegypt.edu:8080/bitstream/handle/10526/4237/Using%20Trusted%20Platform%20Module%20for%20Securing%20Virtual%20Environment%20Access%20in%20Cloud.pdf
2084 * GNU Parallel was cited in: Weakly Supervised Learning for
2085 Compositional Sentiment Recognition
2086 http://computerlinguist.org/static/downloads/ma-thesis/Master_Thesis-Michael_Haas-Weakly_Supervised_Learning_for_Compositional_Sentiment_Recognition.pdf
2088 * GNU Parallel was cited in: Agility and Performance in Elastic
2089 Distributed Storage http://dl.acm.org/citation.cfm?id=2668129
2091 * GNU Parallel was used (unfortunately without citation) in: Large
2092 Scale Author Name Disambiguation in Digital Libraries
2093 http://semanticommunity.info/@api/deki/files/31523/P227_3546.pdf
2095 * GNU Parallel is used in BEDOPS:
2096 https://media.readthedocs.org/pdf/bedops/v2p5p0/bedops.pdf
2098 * Job ad asking for GNU Parallel skills:
2099 http://www.aplitrak.com/?adid=dXMzMTYxMjQuMzg0MTkuMTU1MEBtYW5wb3dlcmZveG5hLmFwbGl0cmFrLmNvbQ#sthash.kYCIhhty.KcoT6HnJ.dpbs
2101 * GNU Parallel: Open Source For You (OSFY) magazine, October 2013
2103 http://www.shakthimaan.com/posts/2014/11/27/gnu-parallel/news.html
2105 * Multithreaded Encryption and Compression
2106 http://www.krazyworks.com/multithreaded-encryption-and-compression/
2108 * GNU Parallel on OSX and Linux
2109 https://darknightelf.wordpress.com/2015/01/01/gnu-parallel-on-osx/
2111 * How to build gnu parallel from source on Ubuntu PC?
2112 http://blog.ovidiuparvu.com/build-gnu-parallel-source-ubuntu-pc/
2114 * GNU parallel for openaddr-process-one
2115 https://nelsonslog.wordpress.com/2015/01/09/gnu-parallel-for-openaddr-process-one/
2117 * From SRA Project to FastQ http://danielecook.com/sra-project-fastq/
2119 * Software Development Tooling
2120 http://www.computer.org/csdl/mags/so/2014/06/mso2014060021.pdf
2122 * コマンドを並列に実行するGNU parallelがとても便利
2123 http://bicycle1885.hatenablog.com/entry/2014/08/10/143612
2125 * Bug fixes and man page updates.
2130 * Remote systems can be divided into hostgroups (e.g. web and db) by
2131 prepending '@groupname/' to the sshlogin. Multiple groups can be
2132 given by separating groups with '+'. E.g. @web/www1 @web+db/www2
2135 * Remote execution can be restricted to servers that are part of one
2136 or more groups by '@groupname' as an sshlogin. Multiple groups can
2137 be given by separating groups with '+'. E.g. -S @web or -S @db+web
2139 * With --hostgroup you can restrict arguments to certain hostgroups by
2140 appending '@groupname' to the argument. Multiple groups can be
2141 given by separating groups with '+'. E.g. my_web_arg@web
2142 db-or-web-arg@db+web db-only-arg@db Thanks to Michel Courtine for
2143 developing a prototype for this.
2145 * GNU Parallel was cited in: HTSeq-Hadoop: Extending HTSeq for
2146 Massively Parallel Sequencing Data Analysis using Hadoop
2147 http://essenceofescience.se/wp-content/uploads/2014/11/Siretskiy.pdf
2149 * GNU Parallel was cited in: SlideToolkit: An Assistive Toolset for
2150 the Histological Quantification of Whole Slide Images
2151 http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0110289
2153 * GNU Parallel was cited in: Exploring a multiprocessor design space
2154 to analyze the impact of using STT-RAM in the memory hierarchy
2155 http://conservancy.umn.edu/bitstream/handle/11299/167286/Borse_umn_0130M_15431.pdf
2157 * Command-Line OCR with Tesseract on Mac OS X
2158 https://ryanfb.github.io/etc/2014/11/13/command_line_ocr_on_mac_os_x.html
2160 * Bug fixes and man page updates.
2165 * --env was changed to deal with Bash's new way of exporting a function.
2167 * GNU Parallel was cited in: Exclusion of cosmic rays in
2168 protoplanetary disks. II. Chemical gradients and observational
2169 signatures http://iopscience.iop.org/0004-637X/794/2/123/article
2171 * GNU Parallel was cited in: Application of Machine Learning to
2172 Algorithm Selection for TSP
2173 http://www.dbai.tuwien.ac.at/staff/musliu/art_ictai_cam.pdf
2175 * GNU Parallel was cited in: Performance Models for LTE-Advanced
2177 http://repository.asu.edu/attachments/137242/content/Tyagi_asu_0010E_14116.pdf
2179 * GNU Parallel was used (unfortunately without citation) in: De Novo
2180 Insertions and Deletions of Predominantly Paternal Origin Are
2181 Associated with Autism Spectrum Disorder
2182 http://www.cell.com/cms/attachment/2019079667/2039310868/mmc1.pdf
2184 * GNU Parallel was determined 'popular' by Statistical Analysis of
2185 Popular Open Source Software Projects and Their Communities
2186 http://andiwre.itmaranatha.org/prosiding/ICITEE2014/PaperAndiWRE-ICITEE2014.pdf
2188 * GNU Parallel is demonstrated in: Data Science at the Command Line:
2189 Facing the Future with Time-Tested Tools
2191 * GNU Parallel was covered in a talk at Sydney Perl Mongers group
2192 http://www.openfusion.net/talks/pwp/#24
2194 * GNU Parallel and how to get started with it
2195 http://www.jduck.net/blog/2014/09/30/gnu-paralell/
2197 * Behat/Selenium/Parallel
2198 http://jaffamonkey.com/behat-selenium-parallel/
2200 * Comparing Golang, Scala, Elixir and Ruby for ETL
2201 http://www.dimroc.com/2014/09/29/etl-language-showdown/
2203 * Assemble a list of which of these hosts are up or down
2204 http://opsfun.wordpress.com/2014/03/31/gnu-parallel/
2206 * Running commands on many nodes simultaneously
2207 http://opsfun.wordpress.com/2014/03/31/19/
2209 * Ubuntu 13.04でGNU ParallelをGNUモードで動かす
2210 http://qiita.com/YusukeSuzuki@github/items/7b96b5876bf980f21e85
2212 * Bug fixes and man page updates.
2217 * If the file give as --sshloginfile is changed it will be re-read
2218 when a job finishes though at most once per second. This makes it
2219 possible to add and remove hosts while running.
2221 * Brutha uses GNU Parallel https://pypi.python.org/pypi/brutha/1.0.2
2223 * OCRmyPDF uses GNU Parallel https://github.com/fritz-hh/OCRmyPDF/
2225 * GNU Parallel was presented at Balti and Bioinformatics "On-Air"
2226 http://youtu.be/UtXlr19xTh8?t=2h5m0s
2228 * Pleiades Plus uses GNU Parallel
2229 https://github.com/ryanfb/pleiades-plus
2231 * Imagemagick and GNU Parallel
2232 http://deepdish.io/2014/09/15/gnu-parallel/
2234 * GNU Parallel (Sebuah Uji Coba)
2235 http://pr4ka5a.wordpress.com/2014/09/04/gnu-parallel-sebuah-uji-coba/
2237 * GNU Parallel: 并行执行Linux命令
2238 http://blog.csdn.net/xzz_hust/article/details/39183837
2243 * GNU Parallel now uses the same shell it was started from as the
2244 command shell for local jobs. So if GNU Parallel is started from
2245 tcsh it will use tcsh as its shell even if the login $SHELL is
2246 different. For remote jobs the login $SHELL will be used.
2248 * The whole current environment in bash can be copied by using a shell
2249 wrapper function (Search manual for env_parallel).
2251 * --plus adds the replacement strings {+/} {+.} {+..} {+...} {..}
2252 {...} {/..} {/...}. The idea being that '+foo' matches the opposite
2253 of 'foo' and {} = {+/}/{/} = {.}.{+.} = {+/}/{/.}.{+.} = {..}.{+..}
2254 = {+/}/{/..}.{+..} = {...}.{+...} = {+/}/{/...}.{+...}
2256 * GNU Parallel now deals correctly with the combination
2257 rsync-3.1.X-client and rsync-2.5.7-server
2259 * GNU Parallel was cited in: A Web Service for Scholarly Big Data
2260 Information Extraction
2261 http://patshih.ist.psu.edu/publications/Williams-CiteSeerExtractor-ICWS14.pdf
2263 * Comparison of the speed of different GNU Parallel versions:
2264 http://lists.gnu.org/archive/html/parallel/2014-08/msg00030.html
2266 * GNU Parallel was covered in the webcast 2014-08-20: Data Science at
2267 the Command Line http://www.oreilly.com/pub/e/3115
2269 * Distributed processing with GNU parallel
2270 http://kazjote.eu/2014/08/11/distributed-processing-with-gnu-parallel
2272 * A Peek into GNU Parallel
2273 http://blog.dataweave.in/post/94238943763/a-peek-into-gnu-parallel
2275 * Сборка GNU parallel для CentOS/RHEL
2276 http://www.stableit.ru/2014/07/gnu-parallel-centosrhel.html
2278 * Bug fixes and man page updates.
2283 * {= perl expression =} can be used as replacement string. The
2284 expression should modify $_. E.g. {= s/\.gz$// =} to remove .gz from
2285 the string. This makes replacement strings extremely flexible.
2287 * Positional perl expressions (similar to {2}) are given as {=2 perl
2288 expression=} where 2 is the position.
2290 * One small backwards incompatibility: {1}_{2} will replace {2} with
2291 the empty string if there is only one argument. Previously {2} would
2292 have been left untouched.
2294 * Replacement strings can be defined using --rpl. E.g. parallel --rpl
2295 '{.gz} s/\.gz$//' echo {.gz} ::: *.gz
2297 * The parenthesis around {= perl expression =} can be changed with
2300 * --tmux will direct the output to a tmux session instead of
2301 files. Each running jobs will be in its own window.
2303 * --halt 10% will stop spawning new jobs if 10% failed so far.
2305 * GNU Parallel was cited in: bammds: A tool for assessing the ancestry
2306 of low depth whole genome data using multidimensional scaling (MDS)
2307 http://bioinformatics.oxfordjournals.org/content/early/2014/06/28/bioinformatics.btu410.abstract
2309 * GNU Parallel was cited in: Molecular ferroelectric contributions to
2310 anomalous hysteresis in hybrid perovskite solar cells
2311 http://people.bath.ac.uk/aw558/publications/2014/arxiv_hysteresis_14.pdf
2313 * GNU Parallel was cited in: Energy Sorghum-a genetic model for the
2314 design of C4 grass bioenergy crops
2315 http://jxb.oxfordjournals.org/content/early/2014/06/20/jxb.eru229.short
2317 * GNU Parallel was cited in: Web-scale Content Reuse Detection
2318 www.isi.edu/~johnh/PAPERS/Ardi14a.pdf
2320 * Tell your friends to sign up for the Webcast at 2014-08-20 covering
2321 GNU Parallel: Data Science at the Command Line
2322 http://www.oreilly.com/pub/e/3115
2324 * GNU Parallel all the things!
2325 http://longwayaround.org.uk/notes/gnu-parallel-all-the-things/
2327 * Shell command composition and dispatch
2328 http://lukeluo.blogspot.dk/2014/07/linux-virtual-console6-shell-command.html
2330 * Parallelising plink (or anything else) the easy way
2331 http://chrisladroue.com/2012/03/parallelising-plink-or-anything-else-the-easy-way/
2333 * Easy and cheap cluster building on AWS
2334 https://grapeot.me/easy-and-cheap-cluster-building-on-aws.html
2336 * Paralelizace běžných činností v konzoli pomocí GNU Parallel
2337 http://www.abclinuxu.cz/clanky/paralelizace-beznych-cinnosti-v-konzoli-pomoci-gnu-parallel
2339 * [原] Ubuntu 下使用 parallel 命令的注意事项
2340 http://blog.ailms.me/2014/06/28/ubuntu-with-parallel.html
2342 * 简单的并行, 可使用GNU parallel
2343 http://jerkwin.github.io/2014/06/10/GNU-parallel/
2345 * Bug fixes and man page updates.
2350 * --shebang and --shebang-wrap now works on FreeBSD.
2352 * --pipepart works with --header, --regexp, --cat and --fifo.
2354 * ./configure --disable-documentation will not build documentation.
2356 * {%} works as job slot.
2358 * GNU Parallel was cited in: Energy Efficient, High-speed
2359 Communication in WSNs
2360 https://gupea.ub.gu.se/bitstream/2077/35801/1/gupea_2077_35801_1.pdf
2362 * GNU Parallel was cited in: Ferroelectric contributions to anomalous
2363 hysteresis in hybrid perovskite solar cells
2364 http://arxiv.org/pdf/1405.5810.pdf
2366 * Processes Paralleling to Speed up Computing and Tasks Execution in
2368 http://kukuruku.co/hub/nix/processes-paralleling-to-speed-up-computing-and-tasks-execution-in-linux
2370 * Moving / Copying lots of s3 files quickly using gnu parallel
2371 http://blog.aclarke.eu/moving-copying-lots-of-s3-files-quickly-using-gnu-parallel/
2373 * Speeding up grep log queries with GNU Parallel
2374 http://www.tripwire.com/state-of-security/incident-detection/speeding-grep-queries-gnu-parallel/
2376 * Ubuntu - Gnu parallel - It's awesome
2377 http://kasunweranga.blogspot.dk/2014/06/ubuntu-gnu-parallel-its-awesome.html
2379 * Export quicklooks with vector overlay using TuiView
2380 http://spectraldifferences.wordpress.com/2014/03/08/export-quicklooks-with-vector-overlay-using-tuiview/
2382 * GNU Parallel指南 http://my.oschina.net/enyo/blog/271612
2384 * GNU parallelで違和感 http://jarp.does.notwork.org/diary/201405c.html#201405301
2386 * Bug fixes and man page updates.
2391 * Use --semaphoretimeout to ignore the semaphore lock after a while.
2393 * {%} introduced as job slot replacement string. It has known bugs.
2395 * --slotreplace changes slot replacement string.
2397 * GNU Parallel officially in Solaris 11.2beta
2398 https://blogs.oracle.com/alanc/entry/solaris_11_2_changes_to
2400 * GNU Parallel was cited in: A Comparison of Antenna Placement
2401 Algorithms http://abhinavjauhri.com/publications/eap.pdf
2403 * Using GNU Parallel on a PBS cluster (nice use of --shebang-wrap)
2404 https://docs.it4i.cz/anselm-cluster-documentation/resource-allocation-and-job-execution/capacity-computing
2406 * BioLite uses GNU Parallel: https://bitbucket.org/caseywdunn/biolite
2408 * Isitdown uses GNU Parallel: http://www.isi.edu/~calvin/isitdown.md
2410 * Convert FLAC to MP3 with GNU parallel
2411 http://www.blogobramje.nl/posts/Convert_FLAC_to_MP3_with_GNU_parallel/
2413 * JD Edwards Business Function Documentation
2414 http://www.azertech.net/content/jd-edwards-business-function-documentation
2416 * Tools of the trade http://blog.eikeland.se/2014/05/01/tools-of-the-trade/
2418 * How I start a bioinformatics project
2419 http://nickloman.github.io/2014/05/14/how-i-start-a-bioinformatics-project/
2421 * No:The-Me GNU Parallel http://adityalaghate.in/gnu-parallel.html
2423 * Bug fixes and man page updates.
2428 * --pipepart is a highly efficient alternative to --pipe if the input
2429 is a real file and not a pipe.
2431 * If using --cat or --fifo with --pipe the {} in the command will be
2432 replaced with the name of a physical file and a fifo respectively
2433 containing the block from --pipe. Useful for commands that cannot
2434 read from standard input (stdin).
2436 * --controlmaster has gotten an overhaul and is no longer
2439 * --env is now copied when determining CPUs on remote system. Useful
2440 for copying $PATH if parallel is not in the normal path.
2442 * --results now chops the argument if the argument is longer than the
2443 allowed path length.
2445 * Build now survives if pod2* are not installed.
2447 * The git repository now contains tags of releases.
2449 * GNU Parallel was cited in: Proactive System for Digital Forensic
2451 http://dspace.library.uvic.ca:8080/bitstream/handle/1828/5237/Alharbi_Soltan_PhD_2014.pdf
2453 * GNU Parallel was cited in: Beyond MAP estimation with the
2454 track-oriented multiple hypothesis tracker
2455 http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=6766651&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D6766651
2457 * GNU Parallel was cited in: Prokka: rapid prokaryotic genome
2459 http://bioinformatics.oxfordjournals.org/content/early/2014/03/18/bioinformatics.btu153.short
2461 * GNU Parallel was used (unfortunately with improper citation) in:
2462 Perspectives in magnetic resonance: NMR in the post-FFT era
2463 http://www.sciencedirect.com/science/article/pii/S1090780713003054
2465 * GNU Parallel is used in https://github.com/cc2qe/speedseq
2467 * Batch XML validation at the command line.
2468 http://horothesia.blogspot.dk/2014/04/batch-xml-validation-at-command-line.html
2470 * freebayes-parallel uses GNU Parallel
2471 https://github.com/ekg/freebayes/commit/31ee997984cebe8a196381c3de57e618e34a2281
2473 * Org-mode with Parallel Babel http://draketo.de/english/emacs/parallel-babel#sec-2
2475 * Speeding Up Grep Log Queries with GNU Parallel
2476 http://www.cybersecurity.io/speeding-grep-queries-gnu-parallel/
2478 * How to run tbss_2_reg in parallel
2479 http://tadpolebrainimaging.blogspot.dk/2014/03/how-to-run-tbss2reg-in-parallel.html
2481 * GNU parallel example: blastn https://asciinema.org/a/8775
2483 * Iterative DNS Brute Forcing
2484 http://www.room362.com/blog/2014/02/19/iterative-dns-brute-forcing/
2486 * Ejecutando comandos en paralelo
2487 http://jesusmercado.com/guias/ejecutando-comandos-en-paralelo/
2489 * Ejecutando en paralelo en bash (ejemplo con rsync)
2490 http://eithel-inside.blogspot.dk/2014/04/ejecutando-en-paralelo-en-bash-ejemplo.html
2492 * Bug fixes and man page updates.
2497 * Offical package for Alpine Linux now exists:
2498 http://alpinelinux.org/apk/main/x86/parallel
2500 * GNU Parallel was cited in: Estimating uncertainties in statistics
2501 computed from direct numerical simulation
2502 http://dx.doi.org/10.1063/1.4866813
2504 * GNU Parallel was cited in: Vehicle routing problems with time
2505 windows and multiple service workers: a systematic comparison
2506 between ACO and GRASP
2507 http://link.springer.com/article/10.1007/s10100-014-0341-z
2509 * GNU Parallel, quick and easy
2510 http://www.reganmian.net/blog/2014/03/09/gnu-parallel-quick-and-easy/
2512 * Using Multiple CPU Cores With Command Line Tools
2513 http://prateekvjoshi.com/2014/03/07/using-multiple-cpu-cores-with-command-line-tools/
2515 * Batch convert mp3 CBR to VBR
2516 http://blogs.zercle.com/bouroo/2013/03/batch-convert-mp3-cbr-to-vbr/
2518 * Running Behat in parallel with Selenium grid
2519 http://zalas.eu/running-behat-in-parallel-with-selenium-grid/
2521 * Git-Mirror per cronjob aktuell halten
2522 https://www.schtobia.de/2013/git-mirror-per-cronjob-aktuell-halten/
2524 * Пишем многопоточный скрипт на bash
2525 http://dafter.ru/duf/howto/130.html
2527 * 如何利用多核CPU来加速你的Linux命令
2528 http://www.chinadmd.com/file/xpcr6wpctzwtuu3ivwiaatcs_1.html
2530 * Bug fixes and man page updates.
2535 * --tollef has been retired.
2537 * --compress has be redesigned due to bugs.
2539 * Format of --eta and --joblog has changed slightly.
2541 * GNU Parallel was cited in: Speaker Verification and Keyword Spotting
2542 Systems for Forensic Applications
2543 http://lantana.tenet.res.in/website_files/thesis/Phd/srikanth.pdf
2545 * GNU Parallel was cited in: Scaleable Code Clone Detection
2546 http://scg.unibe.ch/archive/phd/schwarz-phd.pdf
2548 * GNU Parallel was cited in: Clone Detection that scales
2549 http://scg.unibe.ch/archive/masters/Vogt14a.pdf
2551 * GNU Parallel was cited in: Scalable Positional Analysis for Studying
2552 Evolution of Nodes in Networks
2553 http://arxiv-web3.library.cornell.edu/pdf/1402.3797
2555 * GNU Parallel was cited in: Aggregate Characterization of User
2556 Behavior in Twitter and Analysis of the Retweet Graph
2557 http://arxiv.org/pdf/1402.2671v1
2559 * GNU Parallel was used (unfortunately without citation) in: Causal
2560 Network Models for Predicting Compound Targets and Driving Pathways
2562 http://jbx.sagepub.com/content/early/2014/02/10/1087057114522690.full
2564 * GNU Parallel was used (unfortunately without citation) in:
2565 Performance and Energy Efficiency of Common Compression /
2566 Decompression Utilities
2567 http://www.researchgate.net/publication/243962643_Performance_and_Energy_Efficiency_of_Common_CompressionDecompression_Utilities_An_Experimental_Study_in_Mobile_and_Workstation_Computer_Platforms/file/3deec51d1dbc0474f9.pdf
2569 * GNU Parallel was used (unfortunately without citation) in: SpringFS:
2570 Bridging Agility and Performance in Elastic Distributed Storage
2571 http://www.istc-cc.cmu.edu/publications/papers/2014/SpringFS-FAST14.pdf
2573 * GNU Parallel was recommended (without citation) in: Redesigning the
2574 Specificity of Protein-DNA Interactions with Rosetta
2575 http://link.springer.com/protocol/10.1007/978-1-62703-968-0_17
2577 * GNU Parallel is co-distributed with RepeatExplorer
2578 http://www.vcru.wisc.edu/simonlab/bioinformatics/programs/repeatexplorer/README.txt
2580 * Convert MP3 to a scrolling spectrum waterfall plot video
2581 http://jdesbonnet.blogspot.dk/2014/02/convert-mp3-to-scrolling-spectrum.html
2583 * PHP wrapper class for the GNU Parallel tool
2584 https://github.com/geopal-solutions/gnu-parallel-wrapper/tree/master
2586 * Exploratory Data Analysis http://www.slideshare.net/thinrhino/gnunify
2588 * Copias de archivos con rsync y parallel
2589 http://linuxmanr4.com/2014/02/20/copias-de-archivos-con-rsync-y-parallel
2591 * Single-Thread-Programme auf Multicore-Rechnern parallelisieren
2592 http://www.adlerweb.info/blog/2014/02/08/linux-single-thread-programme-auf-multicore-rechnern-parallelisieren
2594 * Распараллеливаем процессы для ускорения вычислений и выполнения
2595 заданий в Linux http://savepearlharbor.com/?p=210480
2597 * Bug fixes and man page updates.
2602 * GNU Parallel was cited in: On the likelihood of multiple bit upsets
2604 http://arxiv-web3.library.cornell.edu/pdf/1401.1003
2606 * HaploClique uses GNU Parallel
2607 https://github.com/armintoepfer/haploclique
2609 * Scraping NSScreencast
2610 https://blog.nicolai86.eu/posts/2014-01-12/scraping-nsscreencast/
2612 * 30 Cool Open Source Software I Discovered in 2013
2613 http://www.cyberciti.biz/open-source/30-cool-best-open-source-softwares-of-2013/
2615 * [Unix] 13. The power of doing things in Parallel
2616 http://leetaey.tistory.com/384
2618 * Parallel the execution of a job that read from stdin
2619 http://www.linuxask.com/questions/parallel-the-execution-of-a-job-that-read-from-stdin
2621 * Mon Make à moi (6:38-11:50)
2622 http://videos.rennes.inria.fr/ReNaBI-GO2013/indexPierreLindenbaum.html
2624 * Shell-Abarbeitung beschleunigen: Wie Sie mit parallelen Prozesse
2625 effizienter in der Shell arbeiten
2626 https://www.hosteurope.ch/blog/shell-abarbeitung-beschleunigen-wie-sie-mit-parallelen-prozesse-effizienter-in-der-shell-arbeiten/
2628 * Summary of GNU Parallel tutorial
2629 http://hacktracking.blogspot.dk/2014/01/gnu-parallel-tutorial.html
2631 * Bug fixes and man page updates.
2636 * GNU Parallel now has a motto: For people who live life in the
2639 * Detect if the buffer dir $TMPDIR runs out of space. This changes a
2640 central piece of code, making this release alpha quality.
2642 * --keep-order --(n)onall will sort according to the sshlogin.
2644 * Detect the number of CPUs on DEC Tru64.
2646 * GNU sql: --list-tables for sqlite3.
2648 * GNU Parallel was cited in: Variational Message-Passing: Extension to
2649 Continuous Variables and Applications in Multi-Target Tracking
2650 http://www.ics.uci.edu/~ajfrank/pubs/thesis.pdf
2652 * GNU Parallel was cited in: Genome Assembly: Scaffolding Guided by
2654 https://www.duo.uio.no/handle/10852/37431
2656 * GNU Parallel was cited in: Metagenomic analysis of Mariana Trench
2658 http://repositorio.ul.pt/handle/10451/9436
2660 * GNU Parallel was cited in: Diacritization, automatic segmentation
2661 and labeling for Levantine Arabic speech
2662 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642556
2664 * GNU Parallel was cited in: Investigation of emotion classification
2665 using speech rhythm metrics
2666 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642591
2668 * GNU Parallel was cited in: A Rhythm-Based Analysis of Arabic Native
2669 and Non-Native Speaking Styles
2670 http://www.ijsps.com/uploadfile/2013/1128/20131128014413279.pdf
2672 * GNU Parallel was cited in: Evolutionary optimization of wetlands
2674 http://dl.acm.org/citation.cfm?id=2480400
2676 * GNU Parallel was cited (unfortunately with wrong citation) in:
2677 RDBMS vs NoSQL: Performance and Scaling Comparison
2678 http://www.epcc.ed.ac.uk/sites/default/files/Dissertations/2012-2013/RDBMS%20vs%20NoSQL%20-%20Performance%20and%20Scaling%20Comparison.pdf
2680 * GNU Parallel was used (without proper citation) in: Comprehensive
2681 Analysis Pipeline for Discovery of Human Genetic Variation
2682 http://www.google.com/patents/US20130311106
2684 * Encrypt and decrypt in parallel with GPG
2685 http://blog.tkassembled.com/412/encrypt-and-decrypt-in-parallel-with-gpg/
2687 * Using GNU Parallel to create a SVM classifier
2688 http://ivanyu.me/blog/2013/12/01/parallel/
2690 * Parallel xz compression
2691 http://anthon.home.xs4all.nl/rants/2013/parallel_xz/
2693 * Got CPUs to burn? Put 'em to work with GNU parallel
2694 http://baoilleach.blogspot.dk/2013/11/got-cpus-to-burn-put-em-to-work-with.html
2697 http://pastebin.com/JmnB9ffq
2699 * Gnu Parallel for fun and profit
2700 https://gist.github.com/celoyd/f7eb55ad69c9b33fd8c3
2702 * Parallelization of Exploitation
2703 http://rantsideasstuff.com/parallelization-of-exploitation/
2705 * Running assemblies in parallel
2706 https://khmer-protocols.readthedocs.org/en/v0.8.3/metagenomics/4-assemble.html
2708 * Procesando la contabilidad del PP
2709 http://www.neorazorx.com/2013/07/procesando-la-contabilidad-del-pp.html
2711 * Mon make à moi (French)
2712 http://www.slideshare.net/lindenb/mon-make-moi-tout-sauf-galaxy
2714 * Bug fixes and man page updates.
2719 * A citation notice is printed on stderr only if stderr is a terminal,
2720 the user has not specified --no-notice and the user has not run
2721 --bibtex once. This makes the release alpha quality.
2723 * --compress will compress temporary files. If the output is big and
2724 very compressible this will take up less disk space in $TMPDIR and
2725 possibly be faster due to less disk I/O.
2727 * --compress-program comtrols which program to use for compressing
2730 * --bar show progress as a progress bar compatible with zenity.
2732 * --resume can now be used with --result: Jobs already run will be
2735 * --transfer and --basefile support paths relative to the --workdir by
2736 inserting /./ into the path.
2738 * GNU Parallel was cited in: fastphylo: Fast tools for phylogenetics
2739 http://www.biomedcentral.com/1471-2105/14/334/abstract
2741 * Using GNU parallel
2742 http://davetang.org/muse/2013/11/18/using-gnu-parallel/
2744 * Techlux - GNU - Parallel (German)
2745 https://techlux.de/blog/2013/11/07/gnu-parallel/
2747 * awk, sed, bzip2, grep, wc на всех ядрах
2748 http://vk.com/page-30666517_45528467
2750 * 如何利用多核CPU來加速你的Linux命令 — awk, sed, bzip2, grep, wc等
2751 http://www.hksilicon.com/kb/articles/290543/CPULinuxawk-sed-bzip2-grep-wc
2753 * GNU Parallel (Japanese)
2754 http://jarp.does.notwork.org/diary/201311b.html#20131117
2756 * Bug fixes and man page updates.
2761 * --transfer files with /./ in the path will copy the files relative
2764 * The maximal command length is now cached in a file halfing the
2767 * GNU Parallel was cited in: Investigating speaker gender using rhythm
2768 metrics in Arabic dialects
2769 http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6602389
2771 * GNU Parallel was cited in: Tiedon erist ̈minen ja visualisointi a
2772 lastensuojelun asiakaskertomuksista
2773 https://tampub.uta.fi/handle/10024/84978
2775 * Some Additional Useful Bioinformatics Software
2776 http://nix-bio.blogspot.dk/2013/10/additional-software-for-bioinformatics.html
2778 * GNU Parallel Example Screen Cast (bil to Geotiff conversion)
2779 http://www.youtube.com/watch?v=PpF27eC7Mys
2781 * Using GNU Parallel to roll-your-own Map Reduce!
2782 http://www.rankfocus.com/hello-world/
2784 * Use multiple CPU Cores with your Linux commands
2785 http://www.rankfocus.com/use-cpu-cores-linux-commands/
2787 * Using GNU Parallel at HPC @ Uni.lu
2788 https://hpc.uni.lu/users/use_cases/
2790 * Scaling up with parallelization
2791 https://www.msi.umn.edu/sites/default/files/AdvPython_1.pdf
2793 * How to teach yourself to be a technical tester
2794 http://infiniteundo.com/post/62421363463/qa-toc
2796 * Faster Rasters For All
2797 http://2013.foss4g.org/conf/programme/presentations/52/
2799 * Optimizing translated file downloads
2800 http://www.smartling.com/blog/2013/05/20/optimizing-translated-file-downloads/
2802 * EMC NetWorker parallel saveset cloning with nsrclone and GNU parallel
2803 http://www.beebotech.com.au/2013/10/emc-networker-parallel-saveset-cloning-with-nsrclone-and-gnu-parallel/
2805 * Best Practices for Amazon EMR
2806 http://media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf
2808 * Computing checksums for backup
2809 https://identi.ca/evan/note/6yf1GzAARtyBhj__xzMvAg
2811 * Un exemplu de utilizare a programului GNU parallel
2812 http://vundicind.blogspot.dk/2013/10/exemplu-utilizare-gnu-parallel.html
2815 http://www.slideshare.net/drakeguan/part1-23705978
2817 * なんか気持ちよかです Gnu Parallel
2818 http://a3-lab.jpn.org/note/%E3%81%AA%E3%82%93%E3%81%8B%E6%B0%97%E6%8C%81%E3%81%A1%E3%82%88%E3%81%8B%E3%81%A7%E3%81%99-gnu-parallel
2820 * Bug fixes and man page updates.
2825 * PDF-files of documentation is now included.
2827 * Cloning at warp speed 100 VMs in 1 minute using one command line
2828 http://www.beebotech.com.au/tag/command-line/
2830 * Calcul Quebec's introduction to GNU Parallel
2831 https://wiki.calculquebec.ca/w/GNU_parallel
2833 * Brincando com o GNU parallel
2834 http://blog.tadeucruz.com/2013/09/brincando-com-o-gnu-parallel/
2836 * GNU Parallelで並列処理を行う
2837 http://qiita.com/PENGUINANA_/items/af27a833e835fe17f09b
2839 * Bug fixes and man page updates.
2844 * A tutorial showing much of GNU Parallel's functionality. Spend an
2845 hour walking through the tutorial. Your commandline will love you
2846 for it. man parallel_tutorial
2848 * --line-buffer will buffer output on line basis. --group keeps the
2849 output together for a whole job. --ungroup allows output to mixup
2850 with half a line coming from one job and half a line coming from
2851 another job. --line-buffer fits between these two; it prints a full
2852 line, but will allow for mixing lines of different jobs.
2854 * --record-env records all variables and functions set. Useful to
2855 record the normal environment before using --env _.
2857 * --env _ exports all functions and variables to the remote server
2858 except for the ones recorded.
2860 * New signing key. Due to recommendations from NIST
2861 http://www.keylength.com/en/4/ the signing key was changed from
2862 1024D/ID:FFFFFFF1 to 9888R/ID:88888888.
2864 * Agalma: an automated phylogenomics workflow
2865 http://arxiv.org/pdf/1307.6432
2867 * Job ad asking for GNU Parallel expertise
2868 http://seattle.craigslist.org/est/sof/4006079352.html
2870 * Transient Beowulf Clustering with GNU Parallel and SSHfs
2871 http://www.reddit.com/r/linux/comments/1ka8mn/transient_beowulf_clustering_with_gnu_parallel/
2873 * Aligning to unique regions
2874 http://davetang.org/muse/2013/07/22/aligning-to-unique-regions/
2876 * Top 10 scripting tricks for basic bioinformatics
2877 http://students.washington.edu/bowmanjs/wordpress/?p=873
2879 * Using GNU Parallel to speed up and simplify data analyzes
2880 http://www.sergeymarkov.com/blog/2013/07/using-gnu-parallel-to-speed-up-and-simplify-data-analyzes/
2882 * Compression of files in parallel using GNU parallel
2883 http://codextechnicanum.blogspot.dk/2013/07/compression-of-files-in-parallel-using.html
2885 * Using GNU Parallel with Amazon
2886 media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf
2888 * Some useful comments on GNU Parallel
2889 https://news.ycombinator.com/item?id=6209767
2891 * Using GNU Parallel to count reads mapping to genes for multiple BAMs
2892 http://drduanehassane.com/blog/sequencing-resources
2894 * TimeMachineっぽいバックアップスクリプト
2895 http://rio.tc/2013/07/timemachine-1.html
2897 * GNU ParallelでAndroid NDKの全バージョンを一括ダウンロード
2898 http://qiita.com/mazgi/items/b10bf0ff3da2045d19ab
2900 * Bug fixes and man page updates.
2905 * --round-robin with --pipe will write all blocks to already running
2908 * --env can now transfer Bash function for remote execution. That is
2911 * GNU Parallel was used (unfortunately with improper citation) in:
2912 Understanding the Impact of E-Commerce Software on the Adoption of Structured Data on the Web
2913 http://link.springer.com/chapter/10.1007/978-3-642-38366-3_9#page-1
2915 * GNU Parallel was used (unfortunately with improper citation) in:
2916 CWI at TREC 2012, KBA track and Session Track
2917 http://trec.nist.gov/pubs/trec21/papers/CWI.kba.session.final.pdf
2919 * Mitigation of Adverse Effects Caused by Shock Wave Boundary Layer
2920 Interactions through Optimal Wall Shaping.
2921 http://arc.aiaa.org/doi/abs/10.2514/6.2013-2653
2923 * Using GNU parallel to convert images.
2924 http://www.brunokim.com.br/blog/?p=18
2926 * A quick way to parallelize.
2927 http://timotheepoisot.fr/2013/07/08/parallel/
2929 * GNU Parallel 20130522 ('Rana Plaza') 发布,并行作业执行.
2930 http://www.open-open.com/news/view/371301
2932 * Quite a few bug fixes and man page updates.
2937 * --xapply now recycles arguments if an input source has more
2938 arguments than others.
2940 * The sleep time between jobs is now both increased and decreased
2943 * 10 seconds installation check the signature using GnuPG if GnuPG is
2946 * Developer job asking for GNU Parallel expertise.
2947 http://careers.stackoverflow.com/jobs/35562/developer-big-data-geo-and-web-climate-central
2949 * A small utility program to run youtube-dl in parallel.
2950 https://github.com/dlh/youtube-dl-parallel
2952 * Parallelizing Freesurfer:
2953 http://blog.cogneurostats.com/?p=148
2955 * Bug fixes and man page updates.
2960 * --ctrlc is now default if --pipe is not used; thus making it
2961 possible to kill remotely started jobs simply by pressing Ctrl-C.
2963 * --timeout 200% now means kill jobs that take more than twice the
2964 time of the median run time of a job.
2966 * Jobs are now distributed round robin when having mulitiple
2967 --sshlogin instead of filling up one --sshlogin at a time.
2969 * niceload: darwin version of --io --mem --swap. Thanks to Anders F
2972 * Bug fixes and man page updates.
2977 * 10 seconds installation: wget -O - pi.dk/3 | sh
2979 * HPUX CPU/core detection. Thanks to Javier Tarradas.
2981 * CPU detection for HURD, IRIX, SCO OpenServer and (old) HPUX.
2983 * --ctrlc will send SIGINT to tasks running on remote computers and
2986 * --load now uses 'ps' to see immediately see the number of running
2987 processes instead of 'uptime' thus making --load react much faster.
2989 * Testing on Centos 3.9 and FreeBSD 7 revealed a lot of compability
2990 bugs. Some of these required quite extensive changes making this
2991 release beta quality.
2993 * --retries works with --onall.
2995 * The new --load computation now works on FreeBSD 7.
2997 * --nice works under tcsh.
2999 * GNU Parallel is officially supported in NetBSD.
3000 http://ftp.netbsd.org/pub/pkgsrc/current/pkgsrc/parallel/parallel/README.html
3002 * GNU Parallel is accepted for openSUSE.
3003 http://software.opensuse.org/package/gnu_parallel
3005 * GNU Parallel can be installed under Microsoft Windows (CygWin).
3006 http://blogs.msdn.com/b/hpctrekker/archive/2013/03/30/preparing-and-uploading-datasets-for-hdinsight.aspx
3008 * Excuses for not installing GNU Parallel.
3009 http://oletange.blogspot.dk/2013/04/why-not-install-gnu-parallel.html
3011 * Job advert that requires GNU Parallel competence.
3012 http://versium.com/about/careers/
3014 * Parallelizing Batch Jobs for Fun and Profit.
3015 http://mikeseidle.com/tech/programming/2013/03/parallelizing-batch-jobs
3017 * Processing Transcription Start Sites(TSS) for the entire Mouse genome.
3018 http://qbrc.swmed.edu/2013/03/gnu-parallel-speeding-up-unix-commands-and-scripts/
3020 * GNU parallel is used throughout Scrimer.
3021 http://scrimer.readthedocs.org/en/latest/
3023 * GNU Parallel helped making public documents searchable.
3024 http://danpalmer.me/blog/articles/2013-04-06-unlocking-hillsborough.html
3026 * Identifying big movie files (German).
3027 http://blackappsolutions.wordpress.com/2013/03/23/wenn-der-plattenplatz-knapp-wird-filme-identifizieren-die-viel-platz-belegen/
3029 * Bug fixes and man page updates.
3034 * --resume works with --pipe.
3036 * --resume-failed will go through --joblog, redo the failed jobs and
3037 then continue like --resume.
3039 * Negative positional arguments count from the end: {-1} means the
3040 last argument, {-2} the second to last.
3042 * NetBSD CPU detection.
3044 * --blocksize increases exponentially if it smaller than a full
3047 * Processing n-line records (--pipe -L n) is now much faster.
3049 * --tollef is obsoleted after discussion on the mailing list.
3051 * GNU Parallel is the highest rated tool on:
3052 http://www.biostars.org/show/tools/?sort=votes&since=all%20time
3054 * GNU Parallel was loved during FSFE's #ilovefs campaign.
3055 http://fsfe.org/news/2013/news-20130212-01.en.html
3057 * Using GNU Parallel with s3cmd (Japanese).
3058 http://blog.suz-lab.com/2013/02/s3cmd-gnu-paralells3.html
3060 * Intro to GNU Parallel (Chinese).
3061 http://guiquanz.github.com/2013/02/12/gnu-parallel-intro/
3063 * Bug fixes and man page updates.
3068 * --sshdelay Delay starting next ssh by secs seconds. GNU parallel
3069 will pause secs seconds after starting each ssh. secs can be less
3072 * Official OpenBSD port:
3073 http://ftp.openbsd.org/ports/sysutils/parallel/
3075 * Official DragonFlyBSD package:
3076 http://www.mirrorservice.org/sites/ftp.dragonflybsd.org/packages/amd64/DragonFly-3.0.0/stable/parallel/
3078 * Post about niceload in Hungarian:
3079 http://commandline.blog.hu/2013/01/02/niceload
3081 * 自炊スキャンデータをKobo Gloに最適化
3082 http://interstadial.wordpress.com/2013/01/20/
3084 * GNU parallel+ssh で複数のリモートホストに複数のコマンドを実行させる
3085 http://oshiire.to/archives/1686
3087 * Bug fixes and man page updates.
3092 * --shebang-wrap makes is possible to parallelize scripts by putting
3093 parallel in the shebang line (the first #! line in scripts).
3095 * --delay puts in a delay after starting each job. Useful to avoid
3096 raceconditions and thundering herd problems.
3098 * --results now uses / as separator instead of TAB and thus creates
3099 subdirs. Thanks to Drew Frank.
3101 * parallel: OpenBSD CPU detection. Thanks to Michał Markowski.
3103 * niceload --sensor allows for negative numbers to signify a lower
3104 number means the limit is lower.
3106 * niceload --prg suspend a named program that is already running.
3108 * niceload multiple --pid suspend process ids that are already running.
3110 * Convertir des images avec find et imagemagick
3111 http://roger.b.over-blog.com/article-convertir-des-images-avec-find-et-imagemagick-113416637.html
3113 * Bug fixes and man page updates.
3118 * niceload --sensor makes it possible to use a program to control if a
3119 program should be suspended.
3121 * GNU Parallel was part of the justification for Nordic Free Software
3123 https://fsfe.org/news/2012/news-20121112-01.html
3125 * Dateien schneller packen und konvertieren mit GNU parallel
3126 http://www.linux-community.de/Archiv/Tipp-der-Woche/Dateien-schneller-packen-und-konvertieren-mit-GNU-parallel
3128 * Processing images from Lunar Reconnaissance Orbiter Narrow Angle
3129 Camera http://lunokhod.org/?p=774
3131 * GNU Parallel is used in types2: Type and Hapax Accumulation Curves
3132 http://www.cs.helsinki.fi/u/josuomel/types2/
3134 * GNU Parallel used in: A Hybrid Factor Analysis and Probabilistic
3135 PCA-based system for Dictionary Learning and Encoding for Robust
3137 http://www.superlectures.com/odyssey2012/lecture.php?id=8&lang=en
3138 http://www.cse.iitm.ac.in/~mrsri/ppca.pdf
3140 * Mapreduce avec parallel, cat et une redirection
3141 http://datacratic.com/site/blog/mapreduce-avec-parallel-cat-et-une-redirection
3143 * GNU Parallel for Large Batches of Small Jobs
3144 https://support.scinet.utoronto.ca/wiki/images/7/7b/Tech-talk-gnu-parallel.pdf
3146 * GNU Parallel used in black belt tip (8:50-10:12)
3147 https://aws.amazon.com/apac/awspodcast/episode20/
3149 * Bug fixes and man page updates.
3154 * --results structures output files so they can be imported using
3155 Pandas (http://pandas.pydata.org/). Useful when doing simulations to
3156 select output from some arguments.
3158 * Use --env to transfer environment variables through ssh to remote
3161 * GNU Parallel is accepted for Ubuntu Quantal.
3162 http://packages.ubuntu.com/quantal/parallel
3164 * GNU Parallel was requested for OpenSUSE (go vote!)
3165 https://features.opensuse.org/314461
3167 * Kneth's Korner: Map/Reduce and GNU Parallel
3168 http://kenneth.geisshirt.dk/2012/10/mapreduce-and-gnu-parallel.html
3170 * Blog post in Japanese by Siguniang.
3171 https://siguniang.wordpress.com/2012/09/09/notes-on-gnu-parallel-the-command-line-power-tool/
3172 (Siguniang mentions the logo is called 'The Cafe Wall Illusion')
3173 http://www.michaelbach.de/ot/ang_cafewall/index.html
3175 * GNU Parallel, where have you been all my life?
3176 http://ssdigit.nothingisreal.com/2012/09/gnu-parallel-where-have-you-been-all-my.html
3178 * Reference-free ddRADseq analysis tools uses GNU Parallel.
3179 https://github.com/brantp/rtd#readme
3181 * When bash just isn’t quick enough.
3182 https://soimasysadmin.wordpress.com/2012/08/15/gnu-parallel-when-bash-just-isnt-quick-enough/
3184 * Using GNU Parallel to Package Multiple Jobs in a Single PBS Job.
3185 http://www.nas.nasa.gov/hecc/support/kb/Using-GNU-Parallel-to-Package-Multiple-Jobs-in-a-Single-PBS-Job_303.html
3187 * GNU Parallel Notes.
3188 http://xed.ch/help/parallel.html
3190 * Bug fixes and man page updates.
3195 * Due to a bugfix the main flow has changed. Making this release beta
3198 * Parallel Proxy Scraper & Checker Tool
3199 https://www.youtube.com/watch?v=iXCeR_XsP6o
3201 * Bug fixes and man page updates.
3206 * GNU Parallel was presented at Chiang Mai Bar Camp
3207 http://barcampchiangmai.org/
3209 http://www.cnx-software.com/2012/07/02/use-gnu-parallel-to-speed-up-script-execution-on-multiple-cores-andor-machines/
3211 * I don't always max out all my CPUs, but when I do, I do it with GNU
3213 http://memegenerator.net/instance/22638454
3215 * Bug fixes and man page updates.
3220 * '-L n --pipe' will use records of n lines. This is useful when
3221 processing data that have fixed records with a fixed number of
3224 * --filter-hosts will remove down hosts. For each remote host: check
3225 that login through ssh works. If not: do not use this host.
3226 Currently you can not put --filter-hosts in a profile, $PARALLEL,
3227 /etc/parallel/config or similar. This is because GNU Parallel uses
3228 GNU Parallel to compute this, so you will get an infinite loop. This
3229 will likely be fixed in a later release.
3231 * --pipe now uses fork() instead of busy wait. The performance should
3232 be better on computers with >10 cores while remaining the same on
3233 computers with few cores.
3235 * GNU Parallel will be represented at Chiang Mai Bar Camp.
3236 http://barcampchiangmai.org/
3238 * Indexing Big Data on Amazon AWS: The Screencast
3239 (Check out his T-shirt at 18:40-21:00).
3240 http://www.opensourceconnections.com/2012/06/06/indexing-big-data-on-amazon-aws-screencast/
3242 * biotoolbox uses GNU Parallel.
3243 https://code.google.com/p/biotoolbox/wiki/Pod_novo_wrapper
3245 * Spiceweasel uses GNU Parallel.
3246 https://github.com/mattray/spiceweasel
3248 * GNU Parallel part of The Administrators Challenge.
3249 http://challenge.twistedrack.com/questions/qs3.php
3251 * Finding Oldest Firefox Code using GNU Parallel.
3252 http://gregoryszorc.com/blog/2012/06/18/finding-oldest-firefox-code/
3254 * Bug fixes (quite a few for remote job running) and man page updates.
3259 * Timings in --joblog now with milliseconds.
3261 * Thesis using GNU Parallel (correctly cited; hooray!).
3262 http://scholarworks.sjsu.edu/etd_projects/222/
3265 http://www.perzl.org/aix/index.php?n=Main.Parallel
3267 * Prokka uses GNU Parallel.
3268 http://bioinformatics.net.au/prokka-manual.html
3270 * GNU Parallel was presented at MUUG.
3271 http://muug.mb.ca/blog/meetings/2012/05/09/may-8th-2012-rtfm-gnu-parallel1/
3273 * Blog post: Manipulating many or large files with GNU parallel.
3274 http://compbiously.blogspot.com/2012/05/manipulating-many-or-large-files-with.html
3276 * Blog post: Running commands in parallel using bash.
3277 http://blog.michaelboman.org/2012/04/running-commands-in-parallel-using-bash.html
3279 * Blog post in Hungarian.
3280 http://commandline.blog.hu/2012/05/03/gnu_parallel
3282 * Popularity of GNU Parallel in Debian explodes.
3283 http://qa.debian.org/popcon-graph.php?packages=parallel
3285 * Bug fixes and man page updates.
3290 * A race condition bug caused restructuring of a central piece of the
3291 code. Thus this release of GNU Parallel should be considered beta
3294 * sql --dbsize will now list sizes of all databases if given no
3297 * GNU Parallel is now in Debian Unstable.
3298 apt-get install parallel
3300 * Article: Computational and experimental analyses of
3301 retrotransposon-associated minisatellite DNAs in the soybean genome.
3302 http://www.biomedcentral.com/content/supplementary/1471-2105-13-s2-s13-s1.pdf
3304 * Blog post: GNU parallel - the best thing since sliced bread.
3305 https://arrayal.wordpress.com/2012/03/27/gnu-parallel-the-best-thing-since-sliced-bread/
3307 * Blog post: GNU Parallel makes everything faster.
3308 http://compbiously.blogspot.com/2012/03/gnu-parallel-makes-everything-faster.html
3310 * Blog post (German): Howto: GNU parallel.
3311 http://d24m.de/2012/04/05/howto-gnu-parallel/
3313 * Blog post: Running in Parallel
3314 http://interactivity.ifactory.com/2012/04/running-in-parallel/
3316 * 20000 watched the first intro video.
3319 * The first 5 have received their GNU Parallel merchandise
3320 https://www.gnu.org/software/parallel/merchandise.html
3322 * Bug fixes and man page updates.
3327 * Parallel Process Database Dumps.
3328 http://blog.mattoates.co.uk/2012/02/parallel-process-database-dumps.html
3330 * Using GNU Parallel to process images from Mars.
3331 http://lunokhod.org/?p=468
3333 * Using GNU Parallel with bzgrep.
3334 http://filip.rembialkowski.net/did-you-know-gnu-parallel/
3336 * Bug fixes and man page updates.
3341 * --workdir . will use the current working dir. If the current working
3342 dir is beneath your home dir, the value . is treated as the relative
3343 path to your home dir. This means that if your home dir is different
3344 on remote computers (e.g. if your login is different) the relative
3345 path will still be relative to your home dir.
3347 * A texinfo file is now generated from the POD file using pod2texi.
3349 * The bioinformatics article "Fast large-scale clustering of protein
3350 structures using Gauss integrals" mentions GNU Parallel. They forgot
3351 to add the reference. Please remember --bibtex if you use GNU
3352 Parallel in an article.
3353 http://bioinformatics.oxfordjournals.org/content/28/4/510.short
3355 * The first supporter received his merchandise. Did you order yours?
3356 https://www.gnu.org/software/parallel/merchandise.html
3358 * How to use GNU Parallel with samtools.
3359 http://zvfak.blogspot.com/2012/02/samtools-in-parallel.html
3361 * How to use GNU Parallel for vacuuming PostgreSQL tables.
3362 http://blog.timmattison.com/archives/2012/01/24/mini-hack-parallel-vacuuming-in-postgresql/
3364 * Converting e-books with Calibre and GNU Parallel.
3365 http://www.linkhal.de/blog/2012/01/converting-massive-e-book-collections-with-calibre-and-gnu-parrallel/
3367 * Using GNU Parallel for tailing logfiles from multiple servers.
3368 http://silviud.blogspot.com/2012/02/shell-parallel-processing.html
3370 * Bug fixes and man page updates.
3375 * --header : uses the first input line as column names and you can
3376 then use {colname} as a replacement string in the command. This also
3377 works with multiple :::'s.
3379 * --header <regexp> matches a header as a regular expression and
3380 repeats the header for each block with --pipe.
3382 * --resume resumes from the last unfinished job. Useful if you stop
3383 GNU Parallel and restart it later with the same arguments.
3385 * niceload now propagates exit status correctly.
3387 * Show your support for GNU Parallel. For a limited time you can get a
3388 GNU Parallel T-shirt+mug+pen+100 postcards at 20 EUR. See
3389 https://www.gnu.org/software/parallel/merchandise.html
3391 * Options -g -B -T -U -W -Y are retired as warned 6 months ago.
3393 * GNU Parallel referenced in article on Holographic Grid Cloud. Thanks
3394 to Stefano Gallozzi. http://arxiv.org/pdf/1112.6128
3396 * Article in IEEE Software on GNU Parallel. Thanks to Diomidis
3397 Spinellis. http://www.spinellis.gr/blog/20110911/
3399 * An article on Narwhal which uses GNU Parallel. They forgot to add
3400 the reference. Please remember --bibtex if you use GNU Parallel in
3402 http://bioinformatics.oxfordjournals.org/content/early/2011/11/08/bioinformatics.btr613.full.pdf
3404 * Blog post on using GNU Parallel to speed up BLAST queries:
3405 http://blog.mckuhn.de/2012/01/embarrassingly-parallel-blast-search.html
3407 * Video showing Wake-on-LAN with GNU Parallel.
3408 https://www.youtube.com/watch?v=0mB-yIyKFLQ
3410 * Using GNU Parallel with Solr.
3411 http://sujitpal.blogspot.com/2011/12/solr-report-generation-with-python.html
3413 * First job ad including GNU Parallel:
3414 http://seeker.dice.com/jobsearch/servlet/JobSearch?op=101&dockey=xml/7/6/76f858de083a094f74b1a5d3ba53ffc5@endecaindex
3416 * Bug fixes and man page updates.
3421 * --timeout will now kill grandchildren.
3423 * Interview in Hacker Public Radio.
3424 http://hackerpublicradio.org/eps.php?id=0860
3426 * Blog post in Chinese.
3427 http://blog.sina.com.cn/s/blog_3f7652740100y0ju.html
3429 * Bug fixes and man page updates.
3434 * GNU Parallel package for Fedora.
3435 https://admin.fedoraproject.org/pkgdb/acls/name/parallel
3437 * Using GNU Parallel with Mozilla cross referencing.
3438 https://blog.mozilla.com/it/2011/11/15/mxr-improvements/
3440 * Neat flash presentation of GNU Parallel.
3441 http://prezi.com/0nq74b2elgtx/about-gnu-parallel/
3443 * How to create tar files of dirs in parallel.
3444 https://joneslee85.wordpress.com/2011/11/22/shell-tips-how-to-recursively-archive-many-folders/
3446 * Article in Admin Network&Security by Ben Martin.
3447 http://www.admin-magazine.com/HPC/Articles/GNU-Parallel
3449 * Blog post in Polish.
3450 http://blog.tiger.com.pl/2011/01/05/gnu-parallel/
3452 * Blog post on using GNU Parallel of Mac OS X.
3453 http://www.0xcb0.com/2011/10/19/running-parallel-bash-tasks-on-os-x/
3455 * Blog post in English by researcher.
3456 http://zandyware.wordpress.com/2011/10/15/gnu-parallell-make-best-use-of-your-multicore-computer/
3458 * Blog entry in Chinese.
3459 http://blog.csdn.net/tossense/article/details/6889026
3461 * Blog entry in Japanese on managing many servers.
3462 http://hiroakis.com/blog/2011/11/13/gnu-parallel/
3464 * GNU Parallel is now part of ppbs.
3465 http://physiology.med.cornell.edu/faculty/mason/lab/ppbs/introduction/introduction.html
3467 * How to use GNU Parallel with MCX.
3468 http://mcx.sourceforge.net/cgi-bin/index.cgi?MMC/Doc/MMCCluster
3470 * Bug fixes and man page updates.
3475 * --tag prepends lines with the argument(s). If used with --(n)onall
3476 the line will be prepended with the sshlogin instead.
3478 * --shellquote does not run the command but quotes it using \'s.
3479 Useful for making quoted composed commands.
3481 * --profile can now be repeated merging multiple profiles.
3483 * --bibtex now gives the BibTeX entry.
3484 Thanks to Aleksandr Levchuk for testing.
3486 * Makefile for simple .deb package.
3487 cd packager/debian; make
3489 * sql: --list-databases lists the databases.
3491 * GNU Parallel officially in Fedora 16
3492 http://www.spinics.net/lists/fedora-package-announce/msg67130.html
3494 * Blog post on recompression FLAC audio.
3495 http://blog.oxplot.com/2011/08/reflac-flac-cleanser.html
3497 * The most complex use of ::: I have seen so far.
3498 http://agentzlerich.blogspot.com/2011/09/following-up-on-previous-failures-ive.html
3500 * Example of using GNU Parallel with sudo.
3501 http://loopkid.net/articles/2011/10/07/recursive-chmod-and-chown-on-files
3503 * Use wget and gnu parallel to download mp3s at rocket speed.
3504 http://sdbrain.posterous.com/use-wget-and-gnu-parallel-to-download-mp3s-at
3506 * First CV referring to GNU Parallel.
3507 http://www.peopleperhour.com/freelancers/stephen_/internet_researcher_and_protocol_develop/140602
3509 * Cartwright labs usage of GNU Parallel.
3510 http://cartwrightlab.wikispaces.com/The+Most+Bang+for+Your+Buck
3512 * Bug fixes and man page updates.
3517 * --timeout implemented so that slow commands can be killed
3519 * CPU detection improved for Mac OSX. Thanks to Wayne E. Seguin.
3521 * Example of a parallel webcrawler in the man page.
3523 * Backup up PostgreSQL with GNU Parallel. Thanks to Stephane Wirtel.
3524 http://wirtel.be/2011/07/15/rsync_parallel/
3526 * Blog post in Japanese.
3527 http://dminor11th.blogspot.com/2011/08/gnu-parallel.html
3529 * Blog post about optimizing JPEGs. Thanks to Thomas Jost.
3530 http://schnouki.net/2011/07/22/optimizing-jpeg-pictures/
3532 * Bug fixes and man page updates.
3537 * niceload: --hard will suspend a program if a limit is reached - as
3538 opposed to just slowing the program down.
3540 * niceload: --soft will slow the program down - as opposed to
3541 suspending the program completely.
3543 * niceload: --run-io will slow down a program if disk io goes above a
3546 * niceload: --run-load will slow down a program if loadaverage goes
3547 above a certain limit.
3549 * niceload: --run-mem will slow down a program if free memory goes
3550 below a certain limit.
3552 * niceload: --run-noswap will slow down a program if the computer is
3555 * niceload: --start-io, --start-load, --start-mem, --start-noswap will
3556 defer starting a program until the system is below the limit.
3558 * --io, --load, --mem, and --noswap sets both --run-* and --start-*.
3560 * niceload got a major rewrite and is now object oriented.
3562 * GNU Parallel was presented at Nordic Perl Workshop 2011.
3563 http://conferences.yapceurope.org/npw2011/talk/3416
3565 * Blog post about zcat and GNU Parallel. Thanks to Dr. John.
3566 http://drjohnstechtalk.com/blog/2011/06/gnu-parallel-really-helps-with-zcat/
3568 * 2 blog posts in Japanese. Thanks to Negima.
3569 http://d.hatena.ne.jp/negima1976/20110607/1307412660
3570 http://d.hatena.ne.jp/negima1976/20110628/1309252494
3572 * Blog post for bioinformatics. Thanks to Chris Miller.
3573 http://chrisamiller.com/science/2010/05/26/use-parallel-for-easy-multi-processor-execution/
3575 * Bug fixes and man page updates.
3580 * --onall will run all the jobs on all the computers. This is useful
3581 for systemadinistrators having multiple servers.
3583 * --nonall runs like --onall but reads no arguments from stdin
3584 (standard input), so is possible to do:
3585 parallel --nonall -S computer1,computer2 uptime
3587 * Context replace now works with multiple input sources:
3588 parallel -X echo {1}-{2} ::: 1 2 3 ::: a b c
3590 * --noswap do not start a job on a server that is swapping.
3592 * Article: Parallel processing without Hadoop!
3593 http://www.solutionhacker.com/parallel-processing-without-hadoop/
3595 * Article in Linux Magazine (Spanish). Thanks to Ben Martin.
3596 http://www.linux-magazine.es/issue/67/
3598 * First blog post in Korean. Thanks to 민병국.
3599 http://blog.daum.net/_blog/BlogTypeView.do?blogid=02RQ3&articleno=13380895&admin=#
3601 * Blog post in Japanese. Thanks to Naoya Nakazawa.
3602 http://www.sssg.org/blogs/naoya/archives/2003
3604 * Blog post in English. Thanks to Dagon.
3605 http://hekate.homeip.net/2011/05/29/
3607 * Bug fixes and man page updates.
3612 * Multiple ::: can be put on the command line and will be treated
3613 similar to contents from multiple -a's.
3615 * ::: and :::: can now be mixed on the command line. Use {1} .. {n} to
3616 refer to inputs from the different input sources.
3618 * --xapply is now needed to get xapply's behaviour of reading one line
3619 from each of the input sources.
3621 * Multiple input sources will cause all combinations of arguments from
3622 the sources to be generated. E.g. 'parallel echo {1}+{2} ::: 1 2 :::
3623 a b c' will print 1+a 1+b 1+c 2+a 2+b 2+c. This can often replace
3626 * Implemented {//} for the input line with the basename removed (dirname).
3628 * New video showing the new ::: and :::: input sources.
3629 http://tinyogg.com/watch/iOdhU/ http://www.youtube.com/watch?v=fOX1EyHkQwc
3631 * GNU Parallel now has a logo.
3632 http://www.gnu.org/software/parallel/logo.png
3634 * Article about GNU SQL in USENIX Magazine ;login: (print)
3635 http://www.usenix.org/publications/login/2011-04/
3637 * Using GNU Parallel with EC2. Thanks to Kevin Wu.
3638 http://blog.kevinformatics.com/post/4970574713/interested-in-your-experience-using-gnu-parallel-in
3640 * Review with idea for {..} and {...} in Japanese. Thanks to ichii386.
3641 http://d.hatena.ne.jp/ichii386/20110426
3643 * Upgrade GNU Parallel using Macports. Thanks to Phil Hollenback.
3644 http://www.hollenback.net/index.php/MacportsParallel
3646 * Robert from Echo One discusses using processes instead of threads:
3647 http://rrees.wordpress.com/2011/04/25/many-cores-many-threads/
3649 * How to run GNU Parallel on a SLURM cluster. Thanks to Kevin Stock.
3650 http://www.kevinstock.org/2011/04/using-the-ri-cluster/
3652 * Short article about using GNU Parallel with lame:
3653 http://loopkid.net/articles/2011/04/30/accelerate-lame-mp3-conversion
3655 * Using GNU Parallel to run tail -f in Japanese. Thanks to Clouder.
3656 http://blog.clouder.jp/archives/001140.html
3658 * BBC Research & Development uses GNU Parallel:
3659 http://www.bbc.co.uk/blogs/researchanddevelopment/2010/11/prototyping-weeknotes-41-26112.shtml
3661 * Short article about using GNU Parallel on RHEL. Thanks to Rishi Deshpande.
3662 http://nuclear-imaging.info/site_content/2011/05/11/gnu-parallel/
3664 * Using GNU Parallel for FLAC->MP3 conversion. Thanks to Derek Marcotte.
3665 http://derek.chezmarcotte.ca/?p=286
3667 * Bug fixes and man page updates.
3672 * {#} now works as an alias for $PARALLEL_PID.
3674 * --eta now estimates way more accurately.
3676 * CPU detection code for AIX thanks to Christian Netrwal.
3678 * --joblog contains exitcode.
3680 * Thanks to Ævar Arnfjörð Bjarmason for reading my code.
3682 * GNU Parallel was presented at:
3683 - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm
3684 - OSAA.dk, Aarhus, 2011-04-12
3686 * Blog entry in Japanese. Thanks to Riywo.
3687 http://blog.riywo.com/2011/04/19/022802
3689 * Example of how to use GNU Parallel on PBS clusters. Thanks to Andrew
3690 J Dolgert: http://web0.tc.cornell.edu/wiki/index.php?title=Gnu_Parallel
3692 * First example of using GNU Parallel in Hebrew. Thanks to omry.
3695 * Intro video got past 10000 hits.
3696 http://www.youtube.com/watch?v=OpaiGYxkSuQ
3698 * Bug fixes and man page updates.
3703 * --tollef to be switch compatible with Tollef's parallel. This will
3704 cause -l to mean --load, and the argument separator will be --
3707 * --gnu will force GNU Parallel to behave like GNU Parallel even if
3710 * Site wide config file: /etc/parallel/config
3712 This should solve the issue with some packagers renaming GNU
3713 Parallel to gparallel to avoid the naming conflict.
3715 By putting --tollef in the site wide config file you can deinstall
3716 Tollef's parallel and install GNU Parallel instead without any
3717 change for users or scripts. This is useful for packagers that
3718 currently rename GNU Parallel or simply do not distribute GNU
3719 Parallel because the command name conflicts with Tollef's parallel.
3721 * -L 0 -n 0, and -N 0 implemented. They will read one argument,
3722 but insert 0 arguments on the command line. Useful if you just want
3723 to run the same command with the same arguments a number of times.
3725 * GNU Parallel is now in Fink. Thanks to Jesse Alama.
3726 http://pdb.finkproject.org/pdb/package.php/parallel
3728 * Opscode Cookbook for Chef. Thanks to Joshua Timberman.
3729 https://github.com/opscode/cookbooks/tree/master/gnu_parallel
3731 * Man page examples translated into Japanese. Thanks to Koshigoe.
3732 http://w.koshigoe.jp/study/?%5Bsystem%5D+GNU+parallel+%BB%C8%CD%D1%CE%E3#l13
3734 * GNU Parallel will be presented at:
3735 - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm
3736 - OSAA.dk, Aarhus, 2011-04-12
3738 * Video of presentation from FSCONS 2010-11-07. The presenter was
3739 _really_ hoarse that day (Something to do with loads of alcohol the
3740 night before). http://vimeo.com/20838834
3742 * Review with examples in German. Thanks to M. Nieberg.
3743 http://kenntwas.de/2011/linux/gnu-parallel/
3745 * A review of the --pipe option in German. Thanks to Mathias Huber.
3746 http://www.linux-magazin.de/NEWS/GNU-Parallel-20110205-stueckelt-Daten
3748 * A small example of grepping maillogs. Thanks to François Maillet.
3749 http://www.francoismaillet.com/blog/?p=399
3751 * Using GNU Parallel instead of xargs. Thanks to James Cuff.
3752 http://blog.jcuff.net/2011/02/on-train-ride-in.html
3754 * Bug fixes and man page updates.
3759 * --pipe splits piped data into blocks. Each block is piped to a
3760 program for processing. The piping and the programs will be run in
3761 parallel. Useful if the data you want to process is data for a
3762 program and not arguments.
3764 * --blocksize sets the blocksize in bytes for --pipe. The blocksize is
3765 approximate. It can deviate as much as the size of one record.
3768 * --recstart sets the string matching the start of a
3769 record. Default is "".
3771 * --recend sets the string matching the end of a
3772 record. Default is '\n'. To specify none use --recend "".
3774 If both --recstart and --recend are set, the end of a record must be
3775 followed immediately by a start of a record. This is useful if
3776 either recend or recstart can occur in the middle of a record.
3778 * --remove-rec-sep removes the string matched by --recstart and
3781 * --regexp will make GNU Parallel treat --recstart and --recend as
3782 regular expressions.
3784 * --output-as-files will put the output of the programs into files and
3785 instead of giving the output GNU Parallel will output the name of
3788 * -N if used with --pipe sets the number of records to read.
3790 * New video showing --pipe at
3791 http://www.youtube.com/watch?v=1ntxT-47VPA
3793 * GNU Parallel was presented at FOSDEM.
3795 * Article in USENIX Magazine ;login: (print)
3796 http://www.usenix.org/publications/login/2011-02/
3798 * GNU Parallel is now on ohloh.net. Thanks to Wim Muskee.
3799 https://www.ohloh.net/p/gnu-parallel
3801 * Advanced recursive example. Thanks to Ruarí Ødegaard.
3802 http://my.opera.com/ruario/blog/2011/01/24/editing-debian-packages-more-fun-with-gnu
3804 * Small example on using GNU Parallel through 0install (German).
3805 http://forum.ubuntuusers.de/topic/gnu-parallel-mit-zero-install-kurzinfo-kein-wi/
3807 * Bug fixes and man page updates.
3812 * --joblog makes a simple log of completed jobs.
3814 * -X now spreads arguments between job slots when reaching last
3815 argument. Use -j1 to avoid this.
3817 * People on the email list have voted -j+0 to be the new default
3820 * First review in Polish. Thanks to Patryk Krawaczyński.
3821 http://nfsec.pl/root/2458
3823 * Review in Spanish (in print).
3824 https://www.linux-magazine.es/issue/67/moreinfo.html
3826 * Review in English. Thanks to Brian Gough.
3827 http://blogs.fsfe.org/bjg/2011/01/gnu-parallel-a-map-operator-for-the-command-line/
3829 * Review in French. Thanks to Denis Dordoigne.
3830 http://linuxfr.org/2010/12/29/27715.html
3832 * Review in Spanish.
3833 http://gufete.net/index.php?entry=entry110116-200022
3835 * Article with advanced recursive example. Thanks to Ruarí Ødegaard
3836 http://my.opera.com/ruario/blog/2011/01/18/fun-with-gnu-parallel
3838 * Use case for memcache.
3839 http://www.dctrwatson.com/2010/12/how-to-dump-memcache-keyvalue-pairs-fast/
3841 * Bug fixes and man page updates.
3846 * GNU niceload is now part of GNU Parallel. GNU niceload slows down a
3847 program if the load average is above a certain limit.
3849 * Implemented --tmpdir to buffer standard output and standard error in
3852 * Implemented --load to wait until the load is below a limit before
3853 starting another job on that computer.
3855 * Implemented --nice set the niceness of jobs running both locally and
3858 * Implemented --dry-run to print the job without running it.
3860 * Implemented --tty as the old default of assigning a tty to the first
3861 job causes problems.
3863 * Review with focus on clusters. Thanks to Taylor Gillespie
3864 http://www.unixpronews.com/unixpronews-49-20101019GNUParallelSpeedUpProcessingWithMulticoresClusters.html
3866 * Review with focus on protein similarity.
3867 http://kevinformatics.tumblr.com/post/2142473893/cluster-like-computing-using-gnu-parallel
3869 * Review in Spanish.
3870 http://gr3p.com/2010/12/gnu-parallel-acelera-tus-scripts-en-linux
3872 * Quite a few bug fixes and man page updates.
3877 * Implemented {/} for the input line with the path removed (basename).
3879 * Implemented {/.} for the input line with extension and path removed
3882 * Output from --progress is now sent to standard error instead of
3885 * --eta was broken and counted down from 0. Now fixed.
3887 * Standard output and standard error are flushed after every job so if
3888 standard output does not end with a newline it will still be grouped
3889 with the rest of standard output.
3891 * --command, -c, --file, and -f are now removed as options. They were
3892 never used in practice.
3894 * GetOptionsFromArray rewritten to work with old Perl libraries.
3896 * The file COPYING now contains the GNU General Public License 3
3898 * Major rewrite to make the code more object oriented and easier to
3899 maintain in the future.
3904 * Using -j myfile the number of jobs can be changed while GNU Parallel
3905 is running simply by changing the content of myfile.
3907 * Implemented --profile to use different .parallel/config for
3908 different situations.
3910 * Ugly newlines in $PARALLEL and .parallel/config are no longer
3911 needed. Instead you have to use \ in front of special shell
3914 * --workdir puts the files transferred to remote machines in a
3915 specified directory.
3917 * $PARALLEL_PID is set to the process id of GNU Parallel.
3919 * $PARALLEL_SEQ is set to the sequence number of the job.
3921 * -v now only shows the command to run. Use -v -v to show the
3924 * Slow spawning error is now only a warning.
3926 * If stdin is a tty and input is read from stdin you now get a
3929 * GNU sql: \n and \x0a in arguments is replaced with newline.
3931 * Patch for Debian package and spelling mistakes. Thanks to Rogério
3932 Brito <rbrito at ime dot usp dot br>
3934 * Mac OS X Homebrew package. Thanks to Jonathan Palardy <jonathan dot
3935 palardy at gmail dot com>
3937 * FreeBSD port. Thanks to Chris Howey <howeyc at gmail dot com>
3939 * Pardus package. Thanks to Fethican Coşkuner
3940 <fethicanc at gmail dot com>
3942 * First review in Chinese. Thanks to 曾義峰:
3943 http://antbsd.twbbs.org/~ant/wordpress/?p=2876
3945 * First review in print:
3946 http://www.linux-magazine.com/Issues/2010 Nov 2010
3948 * First review in Spanish:
3949 http://www.muylinux.com/2010/10/18/gnu-parallel-computacion-paralela-a-golpe-de-comando
3951 * First review in Dutch thanks to Koen Vervloesem <koen at vervloesem
3953 http://techworld.nl/technologie/33493/gebruik-al-je-processorkernen-met-gnu-parallel.html
3955 * Blog review thanks to R. Tyler Croy <tyler at monkeypox dot org>:
3956 http://unethicalblogger.com/posts/2010/11/gnuparallel_changed_my_life
3958 * 5000 views of the intro video:
3959 http://www.youtube.com/watch?v=OpaiGYxkSuQ
3961 * As usual a bunch of bugfixes and more usage examples in the man
3964 * GNU Parallel was presented at FSCONS 2010-11-07:
3965 http://www.fscons.org/fs/gnu-parallel Hopefully the
3966 video will be online soon.
3971 * See GNU Parallel live at FSCONS 2010-11-07:
3972 http://www.fscons.org/fs/gnu-parallel
3974 * Untested Debian and xUbuntu packages available through OpenSUSE
3976 https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
3978 * Using --retries a job will be retried on another computer if it
3979 fails. This is useful if some jobs fail for no apparent reason (such
3980 as network failure).
3982 * BSD xargs -o (open /dev/tty) is now default for the job running in
3983 foreground. Useful for interactive commands like:
3984 ls | parallel -Xuj1 vi
3986 * GNU sql now supports SQLite.
3988 * Renamed .dburl.aliases to .sql/aliases and /etc/sql/aliases.
3990 * GNU sql now support --list-tables
3992 * Alias for DBURL can contain '?query' part with %-quoting.
3997 * Using --shebang GNU Parallel can be used as the parser for a script.
3998 E.g: #!/usr/bin/parallel --shebang traceroute (followed by lines of
4001 * First community generated bugfixes
4003 * Alt Linux package of GNU Parallel. Thanks to Michael Shigorin <mike
4004 at altlinux dot org>
4006 * Sunfreeware package of GNU Parallel. Thanks to Steven M. Christensen
4007 <sunfreeware at gmail.com>
4009 * Untested CentOS, Fedora, Mandriva, RedHat, and SUSE packages
4010 available through OpenSUSE build service:
4011 https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
4013 * Review of GNU Parallel. Thanks to Andrew McFague amcfague at wgen dot net
4014 http://www.andrew-mcfague.com/linux/utilities-linux/
4015 commands-every-serious-nix-user-should-know/#parallel
4017 * First 1000 views of the intro video
4019 * sql - a small script to access sql bases from the command line which
4020 is a handy companion to parallel --colsep
4025 * Counting semaphore functionality: start a job in the background. If
4026 N jobs are already running, wait for one to complete. Examples:
4027 sem 'sleep 2; echo foo'; sem 'sleep 1; echo bar'; sem --wait
4028 sem -j2 'sleep 2; echo foo'; sem -j2 'sleep 1; echo bar'; sem --wait
4030 * With --colsep a table can be used as input. Example:
4031 cat tab_sep_table | parallel --colsep '\t' echo col1 {1} col2 {2}
4033 * --trim can remove white space around arguments.
4035 * --sshloginfile '..' means use ~/.parallel/sshloginfile
4037 * Zero install package. Thanks to Tim Cuthbertson <tim3d dot junk at
4040 * OpenSUSE package. Thanks to Markus Ammer <mkmm at gmx-topmail dot
4043 * NixOS package. Thanks to Ludovic Courtès <ludo at gnu dot org>
4045 * Web review http://oentend.blogspot.com/2010/08/gnu-parallel.html
4046 Thanks to Pavel Nuzhdin <pnzhdin at gmail dot com>
4048 * Web review http://psung.blogspot.com/2010/08/gnu-parallel.html
4049 Thanks to Phil Sung <psung at alum dot mit dot edu>
4054 * Arguments can now be given on the command line. Example:
4055 parallel bzip2 ::: *.txt
4057 * xapply like functionality. Example:
4058 parallel diff {1} {2} :::: filelist1 filelist2
4059 parallel diff {1} {2} ">"{1.}-{2.}.diff :::: filelist1 filelist2
4061 * Arch Linux package. Thanks to Peter Simons <simons at cryp dot to>
4063 * Mandriva package. Thanks to Sandro Cazzaniga <kharec at mandriva dot
4066 * -L -l -n -s now implies -X unless -m is set
4071 * New video showing the new options.
4072 http://www.youtube.com/watch?v=OpaiGYxkSuQ or at
4073 http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/
4075 * 100% options complete with xargs. All options for xargs can now be
4076 used in GNU Parallel - even the more exotic.
4078 * --basefile for transferring basedata. When running jobs on remote
4079 computers --basefile will transfer files before the first jobs is
4080 run. It can be used to transfer data that remains the same for each
4081 job such as scripts or lookup tables.
4083 * --progress shows progress. To see how many jobs is running on each
4084 server use --progress. It can be turned on even after GNU Parallel
4087 * --eta shows estimated time left in seconds.
4089 * --halt-on-error stops if an error occurs. GNU Parallel will default
4090 to run all jobs - even if some of them fail. With --halt-on-error
4091 GNU Parallel can ignore errors, wait for the currently running jobs
4092 to finish, or stop immediately when an error occurs.
4097 * GNU Parallel now has support for running jobs on remote machines
4099 * Intro video http://www.youtube.com/watch?v=LlXDtd_pRaY
4100 http://openvideo.dailymotion.com/video/xdmqwz_gnu-parallel-script-processing-and_tech
4105 * GNU Parallel is now official GNU software