1 ================================================
2 Mailman - The GNU Mailing List Management System
3 ================================================
5 Copyright (C) 1998-2015 by the Free Software Foundation, Inc.
6 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA
8 Here is a history of user visible changes to Mailman.
17 * When the mailing list's `admin_notify_mchanges` is True, the list owners
18 now get the subscription notification. (Closes: #1)
19 * When `pip` installing Mailman into `/usr/local`, the `master` script is
20 searched for relative to several landmark locations. Originally given by
21 Sambuddha Basu, adapted by Barry Warsaw. (Closes: #3)
22 * Fix the traceback that occurred when trying to convert a `text/html`
23 subpart to plaintext via the `mimedel` handler. Now, a configuration
24 variable `[mailman]html_to_plain_text_command` in the `mailman.cfg` file
25 defines the command to use. It defaults to `lynx`. (Closes: #109)
26 * Confirmation messages should not be `Precedence: bulk`. (Closes #75)
27 * The ``prototype`` archiver is not web accessible so it does not have a
28 ``list_url`` or permalink. Given by Aurélien Bompard.
29 * The REST API incorrectly parsed `is_server_owner` values when given
30 explicitly in the POST that creates a user. (Closes #136)
33 3.0.0 -- "Show Don't Tell"
34 ==========================
39 * Domains now have a list of owners, which are ``IUser`` objects, instead of
40 the single ``contact_address`` they used to have. ``IUser`` objects now
41 also have a ``is_server_owner`` flag (defaulting to False) to indicate
42 whether they have superuser privileges. Give by Abhliash Raj, with fixes
43 and refinements by Barry Warsaw. (LP: #1423756)
44 * Mailing list subscription policy work flow has been completely rewritten.
45 It now properly supports email verification and subscription confirmation
46 by the user, and approval by the moderator using unique tokens.
47 ``IMailingList`` objects now have a ``subscription_policy`` attribute.
49 * Port the REST machinery to Falcon 0.3. (LP: #1446881)
53 * Fix calculation of default configuration file to use when the ``$var_dir``
54 is created by ``mailman start``. (LP: #1411435)
55 * When creating a user with an email address, do not create the user record
56 if the email address already exists. Given by Andrew Stuart.
58 * When deleting a user via REST, make sure all linked addresses are deleted.
59 Found by Andrew Stuart. (LP: #1419519)
60 * When trying to subscribe an address to a mailing list through the REST API
61 where a case-differing version of the address is already subscribed, return
62 a 409 error instead of a 500 error. Found by Ankush Sharma. (LP: #1425359)
63 * ``mailman lists --domain`` was not properly handling its arguments. Given
64 by Manish Gill. (LP: #1166911)
65 * When deleting a user object, make sure their preferences are also deleted.
66 Given by Abhishek. (LP: #1418276)
67 * Be sure a mailing list's acceptable aliases are deleted when the mailing
68 list itself is deleted. (LP: #1432239)
69 * The built-in example ``IArchiver`` implementations now explicitly return
71 * The test suite now runs successfully again with PostgreSQL. Given by
72 Aurélien Bompard. (LP: #1435941)
76 * When specifying a file system path in the [paths.*] section, $cfg_file can
77 be used to expand into the path of the ``-C`` option if given. In the
78 default ``[paths.dev]`` section, ``$var_dir`` is now specified relative to
79 ``$cfg_file`` so that it won't accidentally be relative to the current
80 working directory, if ``-C`` is given.
81 * ``$cwd`` is now an additional substitution variable for the ``mailman.cfg``
82 file's ``[paths.*]`` sections. A new ``[paths.here]`` section is added,
83 which puts the ``var_dir`` in ``$cwd``. It is made the default layout.
87 * Improve the documentation describing how to run Alembic to add new schema
88 migrations. Given by Abhilash Raj.
92 * **Backward incompatible change**: The JSON representation for pending
93 mailing list subscription hold now no longer includes the ``password``
94 key. Also, the ``address`` key has been renamed ``email`` for consistent
95 terminology and other usage.
96 * You can now view the contents of, inject messages into, and delete messages
97 from the various queue directories via the ``<api>/queues`` resource.
98 * You can now DELETE an address. If the address is linked to a user, the
99 user is not delete, it is just unlinked.
100 * A new API is provided to support non-production testing infrastructures,
101 allowing a client to cull all orphaned UIDs via ``DELETE`` on
102 ``<api>/reserved/uids/orphans``. Note that *no guarantees* of API
103 stability will ever be made for resources under ``reserved``.
105 * Domains can now optionally be created with owners; domain owners can be
106 added after the fact; domain owners can be deleted. Also, users now have
107 an ``is_server_owner`` flag as part of their representation, which defaults
108 to False, and can be PUT and PATCH'd. Given by Abhilash Raj, with fixes
109 and refinements by Barry Warsaw. (LP: #1423756)
112 3.0 beta 5 -- "Carve Away The Stone"
113 ====================================
118 * Fixed Unicode errors in the digest runner and when sending messages to the
119 site owner as a fallback. Given by Aurélien Bompard. (LP: #1130957).
120 * Fixed Unicode errors when a message being added to the digest has non-ascii
121 characters in its payload, but no Content-Type header defining a charset.
122 Given by Aurélien Bompard. (LP: #1170347)
123 * Fixed messages without a `text/plain` part crashing the `Approved` rule.
124 Given by Aurélien Bompard. (LP: #1158721)
125 * Fixed getting non-ASCII filenames from RFC 2231 i18n'd messages. Given by
126 Aurélien Bompard. (LP: #1060951)
127 * Fixed `AttributeError` on MIME digest messages. Given by Aurélien Bompard.
132 * The `mailman conf` command no longer takes the `-t/--sort` option; the
133 output is always sorted.
137 * The ``[database]migrations_path`` setting is removed.
141 * The ORM layer, previously implemented with Storm, has been replaced by
142 SQLAlchemy, thanks to the fantastic work by Abhilash Raj and Aurélien
143 Bompard. Alembic is now used for all database schema migrations.
144 * The new logger `mailman.database` logs any errors at the database layer.
148 * Python 3.4 is now the minimum requirement.
149 * You no longer have to create a virtual environment separately when running
150 the test suite. Just use `tox`.
151 * You no longer have to edit `src/mailman/testing/testing.cfg` to run the
152 test suite against PostgreSQL. See `src/mailman/docs/START.rst` for
157 * The RFC 2369 headers added to outgoing messages are now added in sorted
159 * Several changes to the internal API:
161 - `IListManager.mailing_lists` is guaranteed to be sorted in List-ID order.
162 - `IDomains.mailing_lists` is guaranteed to be sorted in List-ID order.
163 - Iteration over domains via the `IDomainManager` is guaranteed to be sorted
164 by `IDomain.mail_host` order.
165 - `ITemporaryDatabase` interface and all implementations are removed.
169 * The Falcon Framework has replaced restish as the REST layer. This is an
170 internal change only.
171 * The JSON representation `http_etag` key uses an algorithm that is
172 insensitive to Python's dictionary sort order.
173 * The address resource now has an additional '/user' sub-resource which can
174 be used to GET the address's linked user if there is one. This
175 sub-resource also supports POST to link an unlinked address (with an
176 optional 'auto_create' flag), and PUT to link the address to a different
177 user. It also supports DELETE to unlink the address. (LP: #1312884)
178 Given by Aurélien Bompard based on work by Nicolas Karageuzian.
179 * The ``/3.0/system`` path is deprecated; use ``/3.0/system/versions`` to get
180 the system version information.
181 * You can access the system configuration via the resource path
182 ``/3.0/system/configuration/<section>``. This returns a dictionary with
183 the keys being the section's variables and the values being their value
184 from ``mailman.cfg`` as verbatim strings. You can get a list of all
185 section names via ``/3.0/system/configuration`` which returns a dictionary
186 containing the ``http_etag`` and the section names as a sorted list under
187 the ``sections`` key. The system configuration resource is read-only.
188 * Member resource JSON now include the ``member_id`` as a separate key.
191 3.0 beta 4 -- "Time and Motion"
192 ===============================
197 * Mailman 3 no longer uses ``zc.buildout`` and tests are now run by the
198 ``nose2`` test runner. See ``src/mailman/docs/START.rst`` for details on
199 how to build Mailman and run the test suite. Also, use ``-P`` to select a
200 test pattern and ``-E`` to enable stderr debugging in runners.
201 * Use the ``enum34`` package instead of ``flufl.enum``.
202 * Use ``setuptools`` instead of ``distribute``, since the latter is defunct.
206 * Add ``reply_to_address`` and ``first_strip_reply_to`` as writable
207 attributes of a mailing list's configuration. (LP: #1157881)
208 * Support pagination of some large collections (lists, users, members).
209 [Florian Fuchs] (LP: #1156529)
210 * Expose ``hide_address`` to the ``.../preferences`` REST API.
211 [Sneha Priscilla.] (LP: #1203519)
212 * Mailing lists can now individually enable or disable any archiver available
213 site-wide. [Joanna Skrzeszewska] (LP: #1158040)
214 * Addresses can be added to existing users, including display names, via the
215 REST API. [Florian Fuchs]
216 * Fixed a crash in the REST server when searching for nonmembers via
217 ``/find`` which we've never seen before, because those members only have an
218 address record, not a user record. This requires a small change in the API
219 where the JSON response's ``address`` key now contains the URL to the
220 address resource, the new ``email`` key contains the email address as a
221 string, and the ``user`` key is optional.
225 * `mailman conf` now has a `-t/--sort` flag which sorts the output by section
226 and then key. [Karl-Aksel Puulmann and David Soto] (LP: 1162492)
227 * Greatly improve the fidelity of the Mailman 2.1 list importer functionality
228 (i.e. ``mailman import21``). [Aurélien Bompard].
232 * Add support for the Exim 4 MTA. [Stephen Turnbull]
233 * When creating the initial file system layout in ``var``, e.g. via
234 ``bin/mailman info``, add an ``var/etc/mailman.cfg`` file if one does not
235 already exist. Also, when initializing the system, look for that file as
236 the configuration file, just after ``./mailman.cfg`` and before
237 ``~/.mailman.cfg``. (LP: #1157861)
241 * The `bounceevent` table now uses list-ids to cross-reference the mailing
242 list, to match other tables. Similarly for the `IBounceEvent` interface.
243 * Added a `listarchiver` table to support list-specific archivers.
247 * Non-queue runners should not create ``var/queue`` subdirectories.
248 [Sandesh Kumar Agrawal] (LP: #1095422)
249 * Creation of lists with upper case names should be coerced to lower case.
251 * Fix REST server crash on `mailman reopen` due to no interception of
252 signals. (LP: #1184376)
253 * Add `subject_prefix` to the `IMailingList` interface, and clarify the
254 docstring for `display_name`. (LP: #1181498)
255 * Fix importation from MM2.1 to MM3 of the archive policy.
256 [Aurélien Bompard] (LP: #1227658)
257 * Fix non-member moderation rule to prefer a member sender if both members
258 and non-members are in the message's sender list. [Aurélien Bompard]
260 * Fix IntegrityError (against PostgreSQL) when deleting a list with content
261 filters. [Aurélien Bompard] (LP: #1117174)
262 * Fix test isolation bug in ``languages.rst``.
263 [Piotr Kasprzyk] (LP: #1308769)
266 3.0 beta 3 -- "Here Again"
267 ==========================
272 * Python 2.7 is now required. Python 2.6 is no longer officially supported.
273 The code base is now also `python2.7 -3` clean, although there are still
274 some warnings in 3rd party dependencies. (LP: #1073506)
278 * **API change**: The JSON representation for held messages no longer
279 includes the `data` key. The values in this dictionary are flatted into
280 the top-level JSON representation. The `key` key is remove since it's
281 redundant. Use `message_id` for held messages, and `address` for held
282 subscriptions/unsubscriptions. The following `_mod_*` keys are inserted
283 without the `_mod_` prefix:
285 - `_mod_subject` -> `subject`
286 - `_mod_hold_date` -> `hold_date`
287 - `_mod_reason` -> `reason`
288 - `_mod_sender` -> `sender`
289 - `_mod_message_id` -> `message_id`
291 * List styles are supported through the REST API. Get the list of available
292 styles (by name) via `.../lists/styles`. Create a list in a specific style
293 by using POST data `style_name=<style>`. (LP: #975692)
294 * Allow the getting/setting of IMailingList.subject_prefix via the REST API
295 (given by Terri Oda). (LP: #1062893)
296 * Expose a REST API for membership change (subscriptions and unsubscriptions)
297 moderation. (LP: #1090753)
298 * Add list_id to JSON representation for a mailing list (given by Jimmy
300 * The canonical resource for a mailing list (and thus its self_link) is now
301 the URL with the list-id. To reference a mailing list, the list-id url is
302 preferred, but for backward compatibility, the posting address is still
304 * You can now PUT and PATCH on user resources to change the user's display
305 name or password. For passwords, you pass in the clear text password and
306 Mailman will hash it before storing.
307 * You can now verify and unverify an email address through the REST API.
308 POST to .../addresses/<email>/verify and .../addresses/<email>/unverify
309 respectively. The POST data is ignored. It is not an error to verify or
310 unverify an address more than once, but verifying an already verified
311 address does not change its `.verified_on` date. (LP: #1054730)
312 * Deleting a user through the REST API also deletes all the user's linked
313 addresses and memberships. (LP: #1074374)
314 * A user's password can be verified by POSTing to .../user/<id>/login. The
315 data must contain a single parameter `cleartext_password` and if this
316 matches, a 204 (No Content) will be returned, otherwise a 403 (Forbidden)
317 is returned. (LP: #1065447)
321 * `[passlib]path` configuration variable renamed to `[passlib]configuration`.
322 * Postfix-specific configurations in the `[mta]` section are moved to a
323 separate file, named by the `[mta]configuration` variable.
324 * In the new `postfix.cfg` file, `postfix_map_cmd` is renamed to
326 * The default list style is renamed to `legacy-default` and a new
327 `legacy-announce` style is added. This is similar to the `legacy-default`
328 except set up for announce-only lists.
332 * The `ban` table now uses list-ids to cross-reference the mailing list,
333 since these cannot change even if the mailing list is moved or renamed.
334 * The following columns were unused and have been removed:
336 - `mailinglist.new_member_options`
337 - `mailinglist.send_reminders`
338 - `mailinglist.subscribe_policy`
339 - `mailinglist.unsubscribe_policy`
340 - `mailinglist.subscribe_auto_approval`
341 - `mailinglist.private_roster`
342 - `mailinglist.admin_member_chunksize`
346 * The `IBanManager` is no longer a global utility. Instead, you adapt an
347 `IMailingList` to an `IBanManager` to manage the bans for a specific
348 mailing list. To manage the global bans, adapt ``None``.
352 * `bin/mailman aliases` loses the `--output`, `--format`, and `--simple`
353 arguments, and adds a `--directory` argument. This is necessary to support
354 the Postfix `relay_domains` support.
355 * `bin/mailman start` was passing the wrong relative path to its runner
356 subprocesses when -C was given. (LP: #982551)
357 * `bin/runner` command has been simplified and its command line options
358 reduced. Now, only one `-r/--runner` option may be provided and the
359 round-robin feature has been removed.
363 * Added support for Postfix `relay_domains` setting for better virtual domain
364 support. [Jimmy Bergman].
365 * Two new events are triggered on membership changes: `SubscriptionEvent`
366 when a new member joins a mailing list, and an `UnsubscriptionEvent` when a
367 member leaves a mailing list. (LP: #1047286)
368 * Improve the --help text for the `start`, `stop`, `restart`, and `reopen`
369 subcommands. (LP: #1035033)
373 * Fixed `send_goodbye_message()`. (LP: #1091321)
374 * Fixed REST server crash on `reopen` command. Identification and test
375 provided by Aurélien Bompard. (LP: #1184376)
378 3.0 beta 2 -- "Freeze"
379 ======================
384 * The link between members and the mailing lists they are subscribed to, is
385 now via the RFC 2369 `list_id` instead of the fqdn listname (i.e. posting
386 address). This is because while the posting address can change if the
387 mailing list is moved to a new server, the list id is fixed.
390 - IListManager.get_by_list_id() added.
391 - IListManager.list_ids added.
392 - IMailingList.list_id added.
393 - Several internal APIs that accepted fqdn list names now require list ids,
394 e.g. ISubscriptionService.join() and .find_members().
395 - IMember.list_id attribute added; .mailing_list is now an alias that
396 retrieves and returns the IMailingList.
398 * `passlib`_ is now used for all password hashing instead of flufl.password.
399 The default hash is `sha512_crypt`. (LP: #1015758)
400 * Internally, all datetimes are kept in the UTC timezone, however because of
401 LP: #280708, they are stored in the database in naive format.
402 * `received_time` is now added to the message metadata by the LMTP runner
403 instead of by `Switchboard.enqueue()`. This latter no longer depends on
404 `received_time` in the metadata.
405 * The `ArchiveRunner` no longer acquires a lock before it calls the
406 individual archiver implementations, since not all of them need a lock. If
407 they do, the implementations must acquire said lock themselves.
408 * The `news` runner and queue has been renamed to the more accurate `nntp`.
409 The runner has also been ported to Mailman 3 (LP: #967409). Beta testers
410 can safely remove `$var_dir/queue/news`.
411 * A mailing list's *moderator password* is no longer stored in the clear; it
412 is hashed with the currently selected scheme.
413 * An `AddressVerificationEvent` is triggered when an `IAddress` is verified
414 or unverified. (LP: #975698)
415 * A `PasswordChangeEvent` is triggered when an `IUser`'s password changes.
417 * When a queue runner gets an exception in its _dispose() method, a
418 `RunnerCrashEvent` is triggered, which contains references to the queue
419 runner, mailing list, message, metadata, and exception. Interested parties
420 can subscribe to that `zope.event` for notification.
421 * Events renamed and moved:
422 * `mailman.chains.accept.AcceptNotification`
423 * `mailman.chains.base.ChainNotification`
424 * `mailman.chains.discard.DiscardNotification`
425 * `mailman.chains.hold.HoldNotification`
426 * `mailman.chains.owner.OwnerNotification`
427 * `mailman.chains.reject.RejectNotification`
428 changed to (respectively):
429 * `mailman.interfaces.chains.AcceptEvent`
430 * `mailman.interfaces.chains.ChainEvent`
431 * `mailman.interfaces.chains.DiscardEvent`
432 * `mailman.interfaces.chains.HoldEvent`
433 * `mailman.interfaces.chains.AcceptOwnerEvent`
434 * `mailman.interfaces.chains.RejectEvent`
435 * A `ConfigurationUpdatedEvent` is triggered when the system-wide global
436 configuration stack is pushed or popped.
437 * The policy for archiving has now been collapsed into a single enum, called
438 ArchivePolicy. This describes the three states of never archive, archive
439 privately, and archive_publicly. (LP: #967238)
443 * Schema migrations (LP: #971013)
445 - mailinglist.include_list_post_header -> allow_list_posts
446 - mailinglist.news_prefix_subject_too -> nntp_prefix_subject_too
447 - mailinglist.news_moderation -> newsgroup_moderation
448 - mailinglist.archive and mailinglist.archive_private have been collapsed
450 - mailinglist.nntp_host has been removed.
451 - mailinglist.generic_nonmember_action has been removed (LP: #975696)
453 * Schema migrations (LP: #1024509)
454 - member.mailing_list -> list_id
455 * The PostgreSQL port of the schema accidentally added a moderation_callback
456 column to the mailinglist table. Since this is unused in Mailman, it was
457 simply commented out of the base schema for PostgreSQL.
461 * Expose `archive_policy` in the REST API. Contributed by Alexander
462 Sulfrian. (LP: #1039129)
466 * New configuration variables `clobber_date` and `clobber_skew` supported in
467 every `[archiver.<name>]` section. These are used to determine under what
468 circumstances a message destined for a specific archiver should have its
469 `Date:` header clobbered. (LP: #963612)
470 * With the switch to `passlib`_, `[passwords]password_scheme` has been
471 removed. Instead use `[passwords]path` to specify where to find the
472 `passlib.cfg` file. See the comments in `schema.cfg` for details.
473 * Configuration schema variable changes:
474 * [nntp]username -> [nntp]user
476 * Header check specifications in the `mailman.cfg` file have changed quite
477 bit. The previous `[spam.header.foo]` sections have been removed.
478 Instead, there's a new `[antispam]` section that contains a `header_checks`
479 variable. This variable takes multiple lines of `Header: regexp` values,
480 one per line. There is also a new `jump_chain` variable which names the
481 chain to jump to should any of the header checks (including the
482 list-specific, and programmatically added ones) match.
486 * Some additional documentation on related components such as Postorius and
487 hyperkitty have been added, given by Stephen J Turnbull.
491 * Fixed the RFC 1153 digest footer to be compliant. (LP: #887610)
492 * Fixed a UnicodeError with non-ascii message bodies in the `approved` rule,
493 given by Mark Sapiro. (LP: #949924)
494 * Fixed a typo when returning the configuration file's header match checks.
496 * List-Post should be NO when posting is not allowed. (LP: #987563)
497 * Non-unicode values in msgdata broke pending requests. (LP: #1031391)
498 * Show devmode in `bin/mailman info` output. (LP: #1035028)
499 * Fix residual references to the old `IMailingList` archive variables.
502 .. _`passlib`: http://packages.python.org/passlib/index.html
505 3.0 beta 1 -- "The Twilight Zone"
506 =================================
511 * Schema migrations have been implemented.
512 * Implement the style manager as a utility instead of an attribute hanging
513 off the `mailman.config.config` object.
514 * PostgreSQL support contributed by Stephen A. Goss. (LP: #860159)
515 * Separate out the RFC 2369 header adding handler.
516 * Dynamically calculate the `List-Id` header instead of storing it in the
517 database. This means it cannot be changed.
518 * Major redesign of the template search system, fixing LP: #788309. $var_dir
519 is now used when search for all template overrides, site, domain, or
520 mailing list. The in-tree English templates are used only as a last
522 * Support downloading templates by URI, including mailman:// URIs. This is
523 used in welcome and goodbye messages, as well as regular and digest headers
524 and footers, and supports both language and mailing list specifications.
525 E.g. mailman:///test@example.com/it/welcome.txt
526 * $user_password is no longer supported as a placeholder in headers and
528 * Mailing lists get multiple chains and pipelines. For example, normal
529 postings go through the `posting_chain` while messages to owners to through
530 `owners_chain`. The default `built-in` chain is renamed to
531 `default-posting-chain` while the `built-in` pipeline is renamed
532 `default-posting-pipeline`.
533 * The experimental `maildir` runner is removed. Use LMTP.
534 * The LMTP server now requires that the incoming message have a `Message-ID`,
535 otherwise it rejects the message with a 550 error. Also, the LMTP server
536 adds the `X-Message-ID-Hash` header automatically. The `inject` cli
537 command will also add the `X-Message-ID-Hash` header, but it will craft a
538 `Message-ID` header first if one is missing from the injected text. Also,
539 `inject` will always set the correct value for the `original_size`
540 attribute on the message object, instead of trusting a possibly incorrect
541 value if it's already set. The individual `IArchiver` implementations no
542 longer set the `X-Message-ID-Hash` header.
543 * The Prototype archiver now stores its files in maildir format inside of
544 `$var_dir/archives/prototype`, given by Toshio Kuratomi.
545 * Improved "8 mile high" document distilled by Stephen J Turnbull from the
546 Pycon 2012 Mailman 3 sprint. Also improvements to the Sphinx build given
547 by Andrea Crotti (LP: #954718).
548 * Pipermail has been eradicated.
549 * Configuration variable `[mailman]filtered_messages_are_preservable`
550 controls whether messages which have their top-level `Content-Type`
551 filtered out can be preserved in the `bad` queue by list owners.
552 * Configuration section `[scrubber]` removed, as is the scrubber handler.
553 This handler was essentially incompatible with Mailman 3 since it required
554 coordination with Pipermail to store attachments on disk.
559 - welcome_msg -> welcome_message_uri
560 - goodbye_msg -> goodbye_message_uri
561 - send_welcome_msg -> send_welcome_message
562 - send_goodbye_msg -> send_goodbye_message
563 - msg_header -> header_uri
564 - msg_footer -> footer_uri
565 - digest_header -> digest_header_uri
566 - digest_footer -> digest_footer_uri
567 - start_chain -> posting_chain
568 - pipeline -> posting_pipeline
569 - real_name -> display_name (mailinglist, user, address)
571 - mailinglist.filter_action
572 - mailinglist.owner_chain
573 - mailinglist.owner_pipeline
577 * Held messages can now be moderated through the REST API. Mailing list
578 resources now accept a `held` path component. GETing this returns all held
579 messages for the mailing list. POSTing to a specific request id under this
580 url can dispose of the message using `Action` enums.
581 * Mailing list resources now have a `member_count` attribute which gives the
582 number of subscribed members. Given by Toshio Kuratomi.
586 * Add property `IUserManager.members` to return all `IMembers` in the system.
587 * Add property `IListmanager.name_components` which returns 2-tuples for
588 every mailing list as (list_name, mail_host).
589 * Remove previously deprecated `IListManager.get_mailing_lists()`.
590 * `IMailTransportAgentAliases` now explicitly accepts duck-typed arguments.
591 * `IRequests` interface is removed. Now just use adaptation from
592 `IListRequests` directly (which takes an `IMailingList` object).
593 * `handle_message()` now allows for `Action.hold` which is synonymous with
594 `Action.defer` (since the message is already being held).
595 * `IListRequests.get_request()` now takes an optional `request_type`
596 argument to narrow the search for the given request.
597 * New `ITemplateLoader` utility.
598 * `ILanguageManager.add()` returns the `ILanguage` object just created.
599 * `IMailinglist.decorators` removed; it was unused
600 * `IMailingList.real_name` -> `IMailingList.display_name`
601 * `IUser.real_name` -> `IUser.display_name`
602 * `IAddress.real_name` -> `IAddress.display_name`
603 * Add property `IRoster.member_count`.
607 * IPython support in `bin/mailman shell` contributed by Andrea Crotti.
609 * The `mailman.cfg` configuration file will now automatically be detected if
610 it exists in an `etc` directory which is a sibling of argv0.
611 * `bin/mailman shell` is an alias for `withlist`.
612 * The `confirm` email command now properly handles `Re:`-like prefixes, even
613 if they contain non-ASCII characters. (LP: #685261)
614 * The `join` email command no longer accepts an `address=` argument. Its
615 `digest=` argument now accepts the following values: `no` (for regular
616 delivery), `mime`, or `plain`.
617 * Added a `help` email command.
618 * A welcome message is sent when the user confirms their subscription via
620 * Global ``-C`` option now accepts an absolute path to the configuration
621 file. Given by Andrea Crotti. (LP: #953707)
625 * Subscription disabled probe warning notification messages are now sent
626 without a `Precedence:` header. Given by Mark Sapiro. (LP: #808821)
627 * Fixed KeyError in retry runner, contributed by Stephen A. Goss.
629 * Fixed bogus use of `bounce_processing` attribute (should have been
630 `process_bounces`, with thanks to Vincent Fretin. (LP: #876774)
631 * Fix `test_moderation` for timezones east of UTC+0000, given by blacktav.
635 3.0 alpha 8 -- "Where's My Thing?"
636 ==================================
641 * Factor out bounce detection to `flufl.bounce`.
642 * Unrecognized bounces can now also be forwarded to the site owner.
643 * mailman.qrunner log is renamed to mailman.runner
644 * master-qrunner.lck -> master.lck
645 * master-qrunner.pid -> master.pid
646 * Four new events are created, and notifications are sent during mailing list
648 - ListCreatingEvent - sent before the mailing list is created
649 - ListCreatedEvent - sent after the mailing list is created
650 - ListDeletingEvent - sent before the mailing list is deleted
651 - ListDeletedEvent - sent after the mailing list is deleted
652 * Four new events are created, and notifications are sent during domain
654 - DomainCreatingEvent - sent before the domain is created
655 - DomainCreatedEvent - sent after the domain is created
656 - DomainDeletingEvent - sent before the domain is deleted
657 - DomainDeletedEvent - sent after the domain is deleted
658 * Using the above events, when a domain is deleted, associated mailing lists
659 are deleted. (LP: #837526)
660 * IDomain.email_host -> .mail_host (LP: #831660)
661 * User and Member ids are now proper UUIDs.
662 * Improved the way enums are stored in the database, so that they are more
663 explicitly expressed in the code, and more database efficient.
667 * Preferences for addresses, users, and members can be accessed, changed, and
668 deleted through the REST interface. Hierarchical, combined preferences for
669 members, and system preferences can be read through the REST interface.
671 * The IMailingList attribute ``host_name`` has been renamed to ``mail_host``
672 for consistency. This changes the REST API for mailing list
673 resources. (LP: #787599)
674 * New REST resource http://.../members/find can be POSTed to in order to find
675 member records. Optional arguments are `subscriber` (email address to
676 search for), `fqdn_listname`, and `role` (i.e. MemberRole). (LP: #799612)
677 * You can now query or change a member's `delivery_mode` attribute through
678 the REST API (LP: #833132). Given by Stephen A. Goss.
679 * New REST resource http://.../<domain>/lists can be GETed in order to find
680 all the mailing lists in a specific domain (LP: #829765). Given by
682 * Fixed /lists/<fqdn_listname>/<role>/<email> (LP: #825570)
683 * Remove role plurals from /lists/<fqdn_listname/rosters/<role>
684 * Fixed incorrect error code for /members/<bogus> (LP: #821020). Given by
686 * DELETE users via the REST API. (LP: #820660)
687 * Moderators and owners can be added via REST (LP: #834130). Given by
689 * Getting the roster or configuration of a nonexistent list did not give a
690 404 error (LP: #837676). Given by Stephen A. Goss.
691 * PATCHing an invalid attribute on a member did not give a 400 error
692 (LP: #833376). Given by Stephen A. Goss.
693 * Getting the memberships for a non-existent address did not give a 404 error
694 (LP: #848103). Given by Stephen A. Goss.
698 * `bin/qrunner` is renamed to `bin/runner`.
699 * `bin/mailman aliases` gains `-f` and `-s` options.
700 * `bin/mailman create` no longer allows a list to be created with bogus owner
701 addresses. (LP: #778687)
702 * `bin/mailman start --force` option is fixed. (LP: #869317)
706 * Update the COPYING file to contain the GPLv3. (LP: #790994)
707 * Major terminology change: ban the terms "queue runners" and "qrunners" since
708 not all runners manage queue directories. Just call them "runners". Also,
709 the master is now just called "the master runner".
713 * New configuration variable in [devmode] section, called `wait` which sets
714 the timeout value used in the test suite for starting up subprocesses.
715 * Handle SIGTERM in the REST server so that the test suite always shuts down
716 correctly. (LP: #770328)
718 Other bugs and changes
719 ----------------------
720 * Moderating a message with Action.accept now sends the message. (LP: #827697)
721 * Fix AttributeError triggered by i18n call in autorespond_to_sender()
723 * Local timezone in X-Mailman-Approved-At caused test failure. (LP: #832404)
724 * InvalidEmailAddressError no longer repr()'s its value.
725 * Rewrote a test for compatibility between Python 2.6 and 2.7. (LP: #833208)
726 * Fixed Postfix alias file generation when more than one mailing list
727 exists. (LP: #874929). Given by Vincent Fretin.
730 3.0 alpha 7 -- "Mission"
731 ========================
736 * Significant updates to the subscription model. Members can now subscribe
737 with a preferred address, and changes to that will be immediately reflected
738 in mailing list subscriptions. Users who subscribe with an explicit
739 address can easily change to a different address, as long as that address
740 is verified. (LP: #643949)
741 * IUsers and IMembers are now assigned a unique, random, immutable id.
742 * IUsers now have created_on and .preferred_address properties.
743 * IMembers now have a .user attribute for easy access to the subscribed user.
744 * When created with add_member(), passwords are always stored encrypted.
745 * In all interfaces, "email" refers to the textual email address while
746 "address" refers to the `IAddress` object.
747 * mailman.chains.base.Chain no longer self registers.
748 * New member and nonmember moderation rules and chains. This effectively
749 ports moderation rules from Mailman 2 and replaces attributes such as
750 member_moderation_action, default_member_moderation, and
751 generic_nonmember_action. Now, nonmembers exist as subscriptions on a
752 mailing list and members have a moderation_action attribute which describes
753 the disposition for postings from that address.
754 * Member.is_moderated was removed because of the above change.
755 * default_member_action and default_nonmember_action were added to mailing
757 * All sender addresses are registered (unverified) with the user manager by
758 the incoming queue runner. This way, nonmember moderation rules will
759 always have an IAddress that they can subscribe to the list (as
760 MemberRole.nonmember).
761 * Support for SMTP AUTH added via smtp_user and smtp_pass configuration
762 variables in the [mta] section. (LP: #490044)
763 * IEmailValidator interface for pluggable validation of email addresses.
764 * .subscribe() is moved from the IAddress to the IMailingList
765 * IAddresses get their registered_on attribute set when the object is created.
769 * [devmode] section gets a new 'testing' variable.
770 * Added password_scheme and password_length settings for defining the
771 default password encryption scheme.
772 * creator_pw_file and site_pw_file are removed.
776 * 'bin/mailman start' does a better job of producing an error when Mailman is
778 * 'bin/mailman status' added for providing command line status on the master
779 queue runner watcher process.
780 * 'bin/mailman info' now prints the REST root url and credentials.
781 * mmsitepass removed; there is no more site password.
785 * Add Basic Auth support for REST API security. (Jimmy Bergman)
786 * Include the fqdn_listname and email address in the member JSON
788 * Added reply_goes_to_list, send_welcome_msg, welcome_msg,
789 default_member_moderation to the mailing list's writable attributes in the
790 REST service. (Jimmy Bergman)
791 * Expose the new membership model to the REST API. Canonical member resource
792 URLs are now much shorter and live in their own top-level namespace instead
793 of within the mailing list's namespace.
794 * /addresses/<email>/memberships gets all the memberships for a given email
796 * /users is a new top-level URL under which user information can be
797 accessed. Posting to this creates new users.
798 * Users can subscribe to mailing lists through the REST API.
799 * Domains can be deleted via the REST API.
800 * PUT and PATCH to a list configuration now returns a 204 (No Content).
804 * Support Python 2.7. (LP: #667472)
805 * Disable site-packages in buildout.cfg because of LP: #659231.
806 * Don't include eggs/ or parts/ in the source tarball. (LP: #656946)
807 * flufl.lock is now required instead of locknix.
811 * Typo in scan_message(). (LP: #645897)
812 * Typo in add_member(). (LP: #710182) (Florian Fuchs)
813 * Re-enable bounce detectors. (LP: #756943)
814 * Clean up many pyflakes problems; ditching pylint.
817 3.0 alpha 6 -- "Cut to the Chase"
818 =================================
823 * The functionality of 'bin/list_members' has been moved to
824 'bin/mailman members'.
825 * 'bin/mailman info' -v/--verbose output displays the file system
826 layout paths Mailman is currently configured to use.
830 * You can now configure the paths Mailman uses for queue files, lock files,
831 data files, etc. via the configuration file. Define a file system 'layout'
832 and then select that layout in the [mailman] section. Default layouts
833 include 'local' for putting everything in /var/tmp/mailman, 'dev' for local
834 development, and 'fhs' for Filesystem Hierarchy Standard 2.3 (LP #490144).
835 * Queue file directories now live in $var_dir/queues.
839 * lazr.restful has been replaced by restish as the REST publishing technology
841 * New REST API for getting all the members of a roster for a specific mailing
843 * New REST API for getting and setting a mailing list's configuration. GET
844 and PUT are supported to retrieve the current configuration, and set all
845 the list's writable attributes in one request. PATCH is supported to
846 partially update a mailing list's configuration. Individual options can be
847 set and retrieved by using subpaths.
848 * Subscribing an already subscribed member via REST now returns a 409 HTTP
850 * Fixed a bug when deleting a list via the REST API. LP: #601899
854 * X-BeenThere header is removed.
855 * Mailman no longer touches the Sender or Errors-To headers.
856 * Chain actions can now fire Zope events in their _process()
858 * Environment variable $MAILMAN_VAR_DIR can be used to control the var/
859 directory for Mailman's runtime files. New environment variable
860 $MAILMAN_UNDER_MASTER_CONTROL is used instead of the qrunner's --subproc/-s
865 * Allow X-Approved and X-Approve headers, equivalent to Approved and
867 * Various test failure fixes. LP: #543618, LP: #544477
868 * List-Post header is retained in MIME digest messages. LP: #526143
869 * Importing from a Mailman 2.1.x list is partially supported.
872 3.0 alpha 5 -- "Distant Early Warning"
873 ======================================
878 * Add REST API for subscription services. You can now:
880 - list all members in all mailing lists
881 - subscribe (and possibly register) an address to a mailing list
882 - unsubscribe an address from mailing list
886 * 'bin/dumpdb' is now 'bin/mailman qfile'
887 * 'bin/unshunt' is now 'bin/mailman unshunt'
888 * Mailman now properly handles the '-join', '-leave', and '-confirm' email
889 commands and sub-addresses. '-subscribe' and '-unsubscribe' are aliases
890 for '-join' and '-leave' respectively.
894 * devmode settings now live in their own [devmode] section.
895 * Mailman now searches for a configuration file using this search order. The
896 first file that exists is used.
898 - -C config command line argument
899 - $MAILMAN_CONFIG_FILE environment variable
905 3.0 alpha 4 -- "Vital Signs"
906 ============================
911 * 'bin/inject' is now 'bin/mailman inject', with some changes
912 * 'bin/mailmanctl' is now 'bin/mailman start|stop|reopen|restart'
913 * 'bin/mailman version' is added (output same as 'bin/mailman --version')
914 * 'bin/mailman members' command line arguments have changed. It also
915 now ignores blank lines and lines that start with #. It also no longer
916 quits when it sees an address that's already subscribed.
917 * 'bin/withlist' is now 'bin/mailman withlist', and its command line
918 arguments have changed.
919 * 'bin/mailman lists' command line arguments have changed.
920 * 'bin/genaliases' is now 'bin/mailman aliases'
924 * A near complete rewrite of the low-level SMTP delivery machinery. This
925 greatly improves readability, testability, reuse and extensibility. Almost
926 all the old functionality has been retained. The smtp_direct.py handler is
928 * Refactor model objects into the mailman.model subpackage.
929 * Refactor most of the i18n infrastructure into a separate flufl.i18n package.
930 * Switch from setuptools to distribute.
931 * Remove the dependency on setuptools_bzr
932 * Do not create the .mo files during setup.
936 * All log files now have a '.log' suffix by default.
937 * The substitution placeholders in the verp_format configuration variable
939 * Add a devmode configuration variable that changes some basic behavior.
940 Most importantly, it allows you to set a low-level SMTP recipient for all
941 mail for testing purposes. See also devmode_recipient.
944 3.0 alpha 3 -- "Working Man"
945 ============================
950 * Configuration is now done through lazr.config. Defaults.py is
951 dead. lazr.config files are essentially hierarchical ini files.
952 * Domains are now stored in the database instead of in the configuration file.
953 * pre- and post- initialization hooks are now available to plugins. Specify
954 additional hooks to run in the configuration file.
955 * Add the environment variable $MAILMAN_CONFIG_FILE which overrides the -C
957 * Make LMTP more compliant with Postfix docs (Patrick Koetter)
958 * Added a NullMTA for mail servers like Exim which just work automatically.
962 * 'bin/mailman' is a new super-command for managing Mailman from the command
963 line. Some older bin scripts have been converted, with more to come.
964 * Mailman now has an administrative REST interface which can be used to get
965 information from and manage Mailman remotely.
966 * Back port of Mailman 2.1's limit on .bak file restoration. After 3
967 restores, the file is moved to the bad queue, with a .psv extension. (Mark
969 * Digest creation is moved into a new queue runner so it doesn't block main
974 * bin/make_instance is no longer necessary, and removed
975 * The debug log is turned up to info by default to reduce log file spam.
977 Building and installation
978 -------------------------
979 * All doc tests can now be turned into documentation, via Sphinx. Just run
980 bin/docs after bin/buildout.
983 3.0 alpha 2 -- "Grand Designs"
984 ==============================
990 * Mailman 3 is now licensed under the GPLv3.
995 * Changed bin/arch to attempt to open the mbox before wiping the old
996 archive. Launchpad bug #280418.
998 * Added digest.mbox and pending.pck to the 'list' files checked by
999 check_perms. Launchpad bug #284802.
1004 * Converted to using zope.testing as the test infrastructure. Use bin/test
1005 now to run the full test suite.
1006 <http://pypi.python.org/pypi/zope.testing/3.7.1>
1007 * Partially converted to using lazr.config as the new configuration
1008 regime. Not everything has been converted yet, so some manual editing
1009 of mailman/Defaults.py is required. This will be rectified in future
1010 versions. <http://launchpad.net/lazr.config>
1011 * All web-related stuff is moved to its own directory, effectively moving
1012 it out of the way for now.
1013 * The email command infrastructure has been reworked to play more nicely
1014 with the plug-in architecture. Not all commands have yet been
1020 * The LMTP server now properly calculates the message's original size.
1021 * For command line scripts, -C names the configuration file to use. For
1022 convenient testing, if -C is not given, then the environment variable
1023 MAILMAN_CONFIG_FILE is consulted.
1024 * Support added for a local MHonArc archiver, as well as archiving
1025 automatically in the remote Mail-Archive.com service.
1026 * The permalink proposal for supporting RFC 5064 has been adopted.
1027 * Mailing lists no longer have a .web_page_url attribute; this is taken from
1028 the mailing list's domain's base_url attribute.
1029 * Incoming MTA selection is now taken from the config file instead of
1030 plugins. An MTA for Postfix+LMTP is added. bin/genaliases works again.
1031 * If a message has no Message-ID, the stock archivers will return None for
1032 the permalink now instead of raising an assertion.
1033 * IArchiver no longer has an is_enabled property; this is taken from the
1034 configuration file now.
1039 * Python 2.6 is the minimal requirement.
1040 * Converted to using zc.buildout as the build infrastructure. See
1041 docs/ALPHA.txt for details.
1042 <http://pypi.python.org/pypi/zc.buildout/1.1.1>
1045 3.0 alpha 1 -- "Leave That Thing Alone"
1046 =======================================
1049 User visible changes
1050 --------------------
1052 * So called 'new style' subject prefixing is the default now, and the only
1053 option. When a list's subject prefix is added, it's always done so before
1054 any Re: tag, not after. E.g. '[My List] Re: The subject'.
1055 * RFC 2369 headers List-Subscribe and List-Unsubscribe now use the preferred
1056 -join and -leave addresses instead of the -request address with a subject
1062 * There is no more separate configure; make; make install step. Mailman 3.0
1063 is a setuptools package.
1064 * Mailman can now be configured via a 'mailman.cfg' file which lives in
1065 $VAR_PREFIX/etc. This is used to separate the configuration from the
1066 source directory. Alternative configuration files can be specified via
1067 -C/--config for most command line scripts. mailman.cfg contains Python
1068 code. mm_cfg.py is no more. You do not need to import Defaults.py in
1069 etc/mailman.cfg. You should still consult Defaults.py for the list of site
1070 configuration variables available to you.
1072 See the etc/mailman.cfg.sample file.
1073 * PUBLIC_ARCHIVE_URL and DEFAULT_SUBJECT_PREFIX now takes $-string
1074 substitutions instead of %-string substitutions. See documentation in
1075 Defaults.py.in for details.
1076 * Message headers and footers now only accept $-string substitutions;
1077 %-strings are no longer supported. The substitution variable
1078 '_internal_name' has been removed; use $list_name or $real_name
1079 instead. The substitution variable $fqdn_listname has been added.
1080 DEFAULT_MSG_FOOTER in Defaults.py.in has been updated accordingly.
1081 * The KNOWN_SPAMMERS global variable is replaced with HEADER_MATCHES. The
1082 mailing list's header_filter_rules variable is replaced with header_matches
1083 which has the same semantics as HEADER_MATCHES, but is list-specific.
1084 * DEFAULT_MAIL_COMMANDS_MAX_LINES -> EMAIL_COMMANDS_MAX_LINES
1085 * All SMTP_LOG_* templates use $-strings and all consistently write the
1086 Message-ID as the first item in the log entry.
1087 * DELIVERY_MODULE now names a handler, not a module (yes, this is a
1088 misnomer, but it will likely change again before the final release).
1093 * Internally, all strings are Unicodes.
1094 * Implementation of a chain-of-rules based approach for deciding whether a
1095 message should initially be accepted, held for approval, rejected/bounced,
1096 or discarded. This replaces most of the disposition handlers in the
1097 pipeline. The IncomingRunner now only processes message through the rule
1098 chains, and once accepted, places the message in a new queue processed by
1100 * Substantially reworked the entire queue runner process management,
1101 including mailmanctl, a new master script, and the qrunners. This should
1102 be much more robust and reliable now.
1103 * The Storm ORM is used for data storage, with the SQLite backend as the
1104 default relational database.
1105 * Zope interfaces are used to describe the major components.
1106 * Users are now stored in a unified database, and shared across all mailing
1108 * Mailman's web interface is now WSGI compliant. WSGI is a Python standard
1109 (PEP 333) allowing web applications to be (more) easily integrated with any
1110 number of existing Python web application frameworks. For more information
1113 http://www.wsgi.org/wsgi
1114 http://www.python.org/dev/peps/pep-0333/
1116 Mailman can still be run as a traditional CGI program of course.
1117 * Mailman now provides an LMTP server for more efficient integration with
1118 supporting mail servers (e.g. Postfix, Sendmail). The Local Mail Transport
1119 Protocol is defined in RFC 2033:
1121 http://www.faqs.org/rfcs/rfc2033.html
1122 * Virtual domains are now fully supported in that mailing lists of the same
1123 name can exist in more than one domain. This is accomplished by renaming
1124 the lists/ and archives/ subdirectories after the list's posting address.
1125 For example, data for list foo in example.com and list foo in example.org
1126 will be stored in lists/foo@example.com and lists/foo@example.org.
1128 For Postfix or manual MTA users, you will need to regenerate your mail
1129 aliases. Use bin/genaliases.
1131 VIRTUAL_HOST_OVERVIEW has been removed, effectively Mailman now operates
1132 as if it were always enabled. If your site has more than one domain,
1133 you must configure all domains by using add_domain() in your
1134 etc/mailman.cfg flie (see below -- add_virtual() has been removed).
1135 * If you had customizations based on Site.py, you will need to re-implement
1136 them. Site.py has been removed.
1137 * The site list is no more. You can remove your 'mailman' site list unless
1138 you want to retain it for other purposes, but it is no longer used (or
1139 required) by Mailman. You should set NO_REPLY_ADDRESS to an address that
1140 throws away replies, and you should set SITE_OWNER_ADDRESS to an email
1141 address that reaches the person ultimately responsible for the Mailman
1142 installation. The MAILMAN_SITE_LIST variable has been removed.
1143 * qrunners no longer restart on SIGINT; SIGUSR1 is used for that now.
1145 Internationalization Big Changes
1146 --------------------------------
1148 * Translators should work only on messages/<lang>/LC_MESSAGES/mailman.po.
1149 Templates files are generated from mailman.po during the build process.
1154 * Confirmed member change of address is logged in the 'subscribe' log, and if
1155 admin_notify_mchanges is true, a notice is sent to the list owner using a
1156 new adminaddrchgack.txt template.
1157 * There is a new list attribute 'subscribe_auto_approval' which is a list of
1158 email addresses and regular expressions matching email addresses whose
1159 subscriptions are exempt from admin approval. RFE 403066.
1161 Command line scripts
1162 --------------------
1164 * Most scripts have grown a -C/--config flag to allow you to specify a
1165 different configuration file. Without this, the default etc/mailman.cfg
1167 * the -V/--virtual-host-overview switch in list_lists has been removed, while
1168 -d/--domain and -f/--full have been added.
1169 * bin/newlist is renamed bin/create_list and bin/rmlist is renamed
1170 bin/remove_list. Both take fully-qualified list names now (i.e. the list's
1171 posting address), but also accept short names, in which case the default
1172 domain is used. newlist's -u/--urlhost and -e/--emailhost switches have
1173 been removed. The domain that the list is being added to must already
1175 * Backport the ability to specify additional footer interpolation variables
1176 by the message metadata 'decoration-data' key.
1178 Bug fixes and other patches
1179 ---------------------------
1181 * Removal of DomainKey/DKIM signatures is now controlled by Defaults.py
1182 mm_cfg.py variable REMOVE_DKIM_HEADERS (default = No).
1183 * Queue runner processing is improved to log and preserve for analysis in the
1184 shunt queue certain bad queue entries that were previously logged but lost.
1185 Also, entries are preserved when an attempt to shunt throws an exception
1187 * The processing of Topics regular expressions has changed. Previously the
1188 Topics regexp was compiled in verbose mode but not documented as such which
1189 caused some confusion. Also, the documentation indicated that topic
1190 keywords could be entered one per line, but these entries were not handled
1191 properly. Topics regexps are now compiled in non-verbose mode and multi-
1192 line entries are 'ored'. Existing Topics regexps will be converted when
1193 the list is updated so they will continue to work.
1194 * The List-Help, List-Subscribe, and List-Unsubscribe headers were
1195 incorrectly suppressed in messages that Mailman sends directly to users.
1196 * The 'adminapproved' metadata key is renamed 'moderator_approved'.