1 =======================
3 =======================
5 Copyright (C) 1998-2018 by the Free Software Foundation, Inc.
6 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA
8 Here is a history of user visible changes to Mailman.
17 * The ``mailman import21`` command properly converts all acceptable_aliases
18 to regexps. (Closes #496)
19 * The ``mailman import21`` command correctly converts autorespond_* settings.
21 * The various ``mailman`` commands now issue a help hint in case of error.
22 Tests have been updated to recognize this. (Closes #519)
26 * Open non-regular log files (e.g. fifos) in write mode instead of append mode.
28 * Autoresponses to posts and -owner and -request messages now work.
30 * Message parts are now properly decoded when trying to remove an Approved:
32 * Outgoing SMTP connections are now closed following message delivery
33 regardless of the max_sessions_per_connection setting. (Closes #529)
37 * Added German translations for mail templates. Thanks to the "Institut für
38 Gebrauchsgrafik" for providing them. (Closes #534)
42 * Allow setting ``max_num_recipients`` for a mailing list. (Closes #508)
43 * Add a per-list visibility option for Members. (Closes #108)
47 * Email commands are now case insensitive. (Closes #353)
48 * Implicit commands sent to -join, -leave and -confirm addresses no longer
49 generate a Results email. (Closes #516)
50 * An ``explicit_header_only`` option has been added to Reply-To: munging to
51 avoid putting the list address in Cc:. (Closes #531)
52 * The default list welcome message has been cleaned up a bit. (Closes #530)
53 * A substitution variable ``user_name_or_email`` has been added to
54 ``list:member:regular:header`` and ``list:member:regular:footer`` templates
55 when personalized deliveries are enabled. (Closes #533)
56 * The template search algorithm was fixed to look for in-tree templates for
57 each language in the search list. (Closes #535)
60 3.2.0 -- "La Villa Strangiato"
61 ==============================
66 * A missing html_to_plain_text_command is now properly detected and logged.
68 * Syntactically invalid sender addresses are now ignored. (Closes #229)
69 * An AttributeError: 'str' object has no attribute 'decode' exception in
70 subject prefixing is fixed. (Closes #359)
71 * Messages with no syntactically valid senders are now automatically
72 discarded. (Closes #369)
73 * Various message holds and rejects that gave 'N/A' as a reason now give an
74 appropriate reason. (Closes #368)
75 * Bounce messages are now composed for proper translations.
76 * Messages with badly encoded ``Subject`` headers no longer crash the message
77 moderation REST API. (Closes #383)
78 * Generated ``regexp`` tables for Postfix now account for possible ``+extra``
79 additions to the ``-bounces`` and ``-confirm`` addresses. (Closes #401)
80 * Address confirmation notices are now properly encoded in the character set
81 of the list's preferred_language. (Closes #395 and #413)
82 * Thanks to Jim Popovitch, certain failures in DNS lookups of DMARC policy
83 will now result in mitigations being applied. (Closes #415)
84 * Messages without a sender can no longer bypass the ``nonmember-moderation``
86 * Invalid regexps in header_matches rules are properly logged and can't be set
87 via REST. (Closes #418)
88 * A list whose name is one of the ``admin``, ``bounces``, ``confirm``, etc.
89 subaddresses can now be posted to. (Closes #433)
90 * The ``admin`` subaddress, a synonym for ``bounces`` and deprecated since
91 Mailman 2.1, has been removed. (Closes #435)
92 * Better support for changing the ``list_name`` property. (Closes #428)
93 * Raw Message text is now coerced to pure ascii before sending, and
94 https://bugs.python.org/issue27321 is now defended against by overriding
95 Message.as_string() to cover more cases than before. (Closes #406)
96 * The override of Message.as_string() has been extended to catch another
97 observed exception. (Closes #441)
98 * The email.message.UserNotification() constructor will now not fail if given
99 a ``text`` argument containing a character not in the charset of the
100 ``lang`` argument. (Closes #437)
101 * A new SQLAlchemy column type ``SAUnicodeXL`` has been implemented to support
102 large columns in MySQL and is used for the ``value`` column of the
103 ``pendedkeyvalue`` table. (Closes #385)
104 * Messages with ``Subject`` headers encoded in an unknown character set no
105 longer throw ``LookupError`` in subject prefixing. (Closes #445)
106 * A list's ``last_post_at`` is now properly updated. (Closes #453)
107 * Fixed an AttributeError in mailman/handlers/decorate.py when
108 member.subscriber is an ``IUser`` instance rather than an ``IAddress``
109 instance. (Closes #449)
110 * Message decoration has been removed from the posting pipeline and added to
111 bulk delivery to avoid duplicate decoration of personalized and VERPed
112 messages. (Closes #450)
113 * The ``mailman inject`` command now reads standard input as documented if
114 there is no ``-f`` or ``--filename`` option. (Closes #459)
115 * Mailman doesn't chmod existing configuration directories on startup (Closes
117 * Calling ``set`` on a template evicts the local cache if the template was
118 cached before. (Closes #463)
119 * The override of Message.as_string() has been extended to catch yet another
120 observed exception. (Closes #470)
121 * Fixed a typo in the help for ``mailman digests --periodic``. (Closes #472)
122 * Character encoding errors in adding headers and footers to multipart messages
123 are detected and ``replaced``. (Closes #409)
124 * The help for ``mailman qfile`` has been fixed to reference ``mailman qfile``
125 rather than the non-existent ``bin/dumpdb``. (Closes #475)
126 * The dmarc rule has been fixed to not throw a TypeError when msg.get('from')
127 returns a header instance. (Closes #477)
128 * ``mailman`` command without any sub-command now invokes ``mailman help`` by
129 default. (Closes #479)
130 * The ``alias_domain`` attribute can become a null string. ``mta/postfix.py``
131 has been fixed to generate proper mappings in this case. (Closes #485)
132 * Fix a bug where duplicate address records can be created when a user adds an
133 existing address with a different case. (Closes #476)
134 * Several additional templates can now be set in the ``var/templates``
135 hierarchy. (Closes #486)
139 * Adopt the ``click`` package for command line parsing. This makes the
140 command line more consistent and pluggable. Also, many CLIs that accepted a
141 "fqdn list name" (i.e. the posting address of a mailing list), now also
142 accept a ``List-ID``. Every attempt has been made to keep the CLI backward
143 compatible, but there may be subtle differences. (Closes #346)
144 * If no listname is given, running ``mailman withlist -r`` must name a
145 function taking no arguments. This can be used to introspect Mailman
146 outside of the context of a mailing list.
147 * Fix ``mailman withlist`` command parsing. (Closes #319)
148 * Add a new option ``--periodic`` to ``mailman digests`` command. It sends out
149 digests for only those Mailing Lists that have ``digest_send_periodic`` option
150 set to ``True``. (Closes #384)
151 * The ``mailman import21`` command now imports DMARC mitigations.
152 * The ``mailman import21`` command no longer creates templates with
153 non-standard names, (Closes #482)
157 * The ``[mailman]pre_hook`` and ``[mailman]post_hook`` variables are
158 deprecated. They can still be specified but they will not be run.
159 * The ``[paths.*]ext_dir`` variable has been removed.
160 * A new logger has been added called ``logging.plugins``.
161 * The ``[styles]paths`` variable has been removed; you can now specify
162 additional styles using the new plugin architecture.
163 * Mailman now also searches at ``/etc/mailman3/mailman.cfg`` for the
168 * The fix for #313 which ported an upstream SQLAlchemy fix to Mailman
169 has been refactored now that SQLAlchemy 1.2 has been released.
173 * Broaden the semantics for ``IListManager.get()``. This API now accepts
174 both ``List-ID``s and fully qualified list names, since that's the most
175 common use case. There's now a separate ``.get_by_fqdn()`` which only
176 accepts the latter and mirrors the already existing ``.get_by_list_id()``.
177 * A new template ``list:user:notice:rejected`` has been added for customizing
178 the bounce message rejection notice.
179 * The ``acceptable_alias`` and ``require_explicit_destination`` attributes
180 have been added to the ``IMailingList`` definition. (Closes #483)
184 * Add a new plugin architecture, which allows third parties to add
185 initialization hooks, REST endpoints, and additional components. Given by
187 * Drop support for Python 3.4. (Closes #373)
188 * Bump minimum requirements for aiosmtpd (>= 1.1) and flufl.lock (>= 3.1).
189 * Add '.pc' (patch directory) to list of ignored patterns when building the
190 documentation with Sphinx.
191 * Domain objects now have an ``alias_domain`` attribute which is normally
192 ``None``, but which can be set to an alternate domain. This will enable
193 the Postfix MTA to generate ``virtual_alias_maps`` which will map list
194 addresses in the domain to addresses in the alternate domain, and will
195 modify the other generated mappings to use the ``alias_domain``. The
196 ``lmtp`` runner will also accept the alias_domain as an alias for the
198 * ``ICacheManager`` now allows evicting a single file from cache.
202 * Allow a mailing list's acceptable aliases to be cleared by calling
203 ``DELETE`` on the list's ``config/acceptable_aliases`` resource.
205 * Allow setting ``max_message_size`` for a mailing list. (Closes #417)
206 * Added new attribute in ``lists/styles`` resource ``styles`` that contains the
207 list of all the styles in Core along with their description. ``style_names``
208 attribute is now deprecated and will be removed in future versions.
209 * Add ``display_name`` for ``member`` in order to expose ``member.display_name``.
211 * Expose ``MailingList.respond_to_post_request`` through REST API. (Closes #420)
212 * Add a new API ``lists/find`` which returns all the lists related to a
213 subscriber. It optionally allows filtering based on a role. (See !388)
214 * ``IAcceptableAliasSet`` resource now interprets an empty string ('') as an
215 empty list ([]). This can be used to clear the list of acceptable aliases of a
216 MailingList in a PATCH or PUT request, without having to use a DELETE request.
217 * Expose ``MailingList.require_explicit_destination`` through REST API.
221 3.1.0 -- "Between The Wheels"
222 =============================
227 * When the mailing list's ``admin_notify_mchanges`` is True, the list owners
228 now get the subscription notification. (Closes: #1)
229 * Fix the traceback that occurred when trying to convert a ``text/html``
230 subpart to plaintext via the ``mimedel`` handler. Now, a configuration
231 variable ``[mailman]html_to_plain_text_command`` in the ``mailman.cfg`` file
232 defines the command to use. It defaults to ``lynx``. (Closes: #109)
233 * Confirmation messages should not be ``Precedence: bulk``. (Closes #75)
234 * Fix constraint violations on mailing list deletes affecting PostgreSQL.
235 Given by Abhilash Raj. (Closes #115)
236 * ``mailman`` command with no subcommand now prints the help text. Given by
237 Abhilash Raj. (Closes #137)
238 * The MHonArc archiver must set stdin=PIPE when calling the subprocess.
239 Given by Walter Doekes.
240 * For now, treat ``DeliveryMode.summary_digests`` the same as
242 (Closes #141). Also, don't enqueue a particular digest if there are no
243 recipients for that digest.
244 * For Python versions earlier than 3.5, use a compatibility layer for a
245 backported smtpd module which can accept non-UTF-8 data. (Closes #140)
246 * Bulk emails are now decorated with headers and footers. Given by Aurélien
247 Bompard. (Closes #145)
248 * Core no longer depends on the standalone ``mock`` module. (Closes: #146)
249 * The logging of moderation reasons has been fixed. Given by Aurélien
251 * Collapse multiple ``Re:`` in Subject headers. Given by Mark Sapiro.
253 * Added Trove classifiers to setup.py. (Closes: #152)
254 * Fix the processing of subscription confirmation messages when the mailing
255 list is set to confirm-then-moderate. (Closes #114)
256 * Fix ``UnicodeEncodeError`` in the hold chain when sending the authorization
257 email to the mailing list moderators. (Closes: #144)
258 * Fix traceback in approved handler when the moderator password is None.
259 Given by Aurélien Bompard.
260 * Fix IntegrityErrors raised under PostreSQL when deleting users and
261 addresses. Given by Aurélien Bompard.
262 * Allow mailing lists to have localhost names with a suffix matching the
263 subcommand extensions. Given by Aurélien Bompard. (Closes: #168)
264 * Don't traceback if a nonexistent message-id is deleted from the message
265 store. Given by Aurélien Bompard, tweaked by Barry Warsaw. (Closes: #167)
266 * Fix a bug in ``SubscriptionService.find_members()`` when searching for a
267 subscribed address that is not linked to a user. Given by Aurélien Bompard.
268 * Fix a REST server crash when trying to subscribe a user without a preferred
269 address. (Closes #185)
270 * Fix membership query when multiple users are subscribed to a mailing list.
271 Reported by Darrell Kresge. (Closes: #190)
272 * Prevent moderation of messages held for a different list. (Closes: #161)
273 * When approving a subscription request via the REST API, for a user who is
274 already a member, return an HTTP 409 Conflict code instead of the previous
275 server traceback (and resulting HTTP 500 code). (Closes: #193)
276 * In decoration URIs (e.g. ``IMailingList.header_uri`` and ``.footer_uri``)
277 you should now use the mailing list's List-ID instead of the
278 fqdn-listname. The latter is deprecated. (Closes #196)
279 * Trying to subscribe an address as a list owner (or moderator or nonmember)
280 which is already subscribed with that role produces a server error.
281 Originally given by Anirudh Dahiya. (Closes #198)
282 * Cross-posting messages held on both lists no longer fails. (Closes #176)
283 * Don't let unknown charsets crash the "approved" rule. Given by Aurélien
284 Bompard. (Closes #203)
285 * Don't let crashes in IArchiver plugins break handlers or runners.
287 * Fix "None" as display name in welcome message. Given by Aditya Divekar.
289 * Fix ``mailman shell`` processing of ``$PYTHONSTARTUP``. (Closes #224)
290 * Fix query bug for ``SubscriptionService.find_members()`` leading to the
291 incorrect number of members being returned. Given by Aurélien Bompard.
293 * Fix header match rule suffix inflation. Given by Aurélien Bompard.
295 * MIME digests now put the individual message/rfc822 messages inside a
296 multipart/digest subpart. (Closes #234)
297 * Nonmember subscriptions are removed when one of the addresses controlled by
298 a user is subscribed as a member. Given by Aditya Divekar. (Closes #237)
299 * Email address validation is now more compliant with RFC 5321. (Closes #266)
300 * A mailing list's ``description`` must not contain newlines. Given by
301 Aurélien Bompard. (Closes: #273)
302 * Allow MailingList.info to be set using the REST API. Given by Aurélien
304 * Extend header filters to also check sub-part headers. (Closes #280)
305 * Allow REST API to PUT and PATCH domain attributes. Allows Postorius domain
306 edit to work. (Closes: #290)
307 * Prevent posting from banned addresses. Given by Aurélien Bompard.
309 * Remove the digest mbox files after the digests are sent. Given by Aurélien
310 Bompard. (Closes: #259)
311 * Transmit the moderation reason and expose it in the REST API as the
312 ``reason`` attribute. Given by Aurélien Bompard.
313 * Don't return a 500 error from the REST API when trying to handle a held
314 message with defective content. Given by Abhilash Raj. (Closes: #256)
315 * Delete subscription requests when a mailing list is deleted. Given by
316 Abhilash Raj. (Closes: #214)
317 * Messages were shunted when non-ASCII characters appeared in a mailing
318 list's description. Given by Mark Sapiro. (Closes: #215)
319 * Fix confirmation of unsubscription requests. (Closes: #294)
320 * Fix ``mailman stop`` not stopping some runners due to PEP 475 interaction.
322 * Update documentation links for ``config.cfg`` settings. (Closes: #306)
323 * Disallow problematic characters in listnames. (Closes: #311)
324 * Forward port several content filtering fixes from the 2.1 branch.
325 (Closes: #330, #331, #332 and #334)
329 * Mailing lists can now have their own header matching rules, although
330 site-defined rules still take precedence. Importing a Mailman 2.1 list
331 with header matching rules defined will create them in Mailman 3, albeit
332 with a few unsupported corner cases. Definition of new header matching
333 rules is not yet exposed through the REST API. Given by Aurélien Bompard.
334 * The default languages from Mailman 2.1 have been ported over. Given by
336 * There is now a configuration setting to limit the characters that can be
341 * ``mailman create <listname@dom.ain>`` will now create missing domains
342 by default. The ``-d``/``--domain`` option is kept for backward
343 compatibility, but now there is a ``-D``/``--no-domain`` option to prevent
344 missing domains from being create, forcing an error in those cases.
345 Given by Gurkirpal Singh. (Closes #39)
346 * ``mailman`` subcommands now properly commit any outstanding transactions.
348 * ``mailman digests`` has grown ``--verbose`` and ``-dry-run`` options.
349 * ``mailman shell`` now supports readline history if you set the
350 ``[shell]history_file`` variable in mailman.cfg. Also, many useful names
351 are pre-populated in the namespace of the shell. (Closes: #228)
355 * MySQL is now an officially supported database. Given by Abhilash Raj.
356 * Fix a problem with tracebacks when a PostgreSQL database is power cycled
357 while Mailman is still running. This ports an upstream SQLAlchemy fix to
358 Mailman in lieu of a future SQLAlchemy 1.2 release. (Closes: #313)
362 * Implement reasons for why a message is being held for moderator approval.
363 Given by Aurélien Bompard, tweaked by Barry Warsaw.
364 * The default ``postauth.txt`` and ``postheld.txt`` templates now no longer
365 include the inaccurate admindb and confirmation urls.
366 * Messages now include a ``Message-ID-Hash`` as the replacement for
367 ``X-Message-ID-Hash`` although the latter is still included for backward
368 compatibility. Also be sure that all places which add the header use the
369 same algorithm. (Closes #118)
370 * ``IMessageStore.delete_message()`` no longer raises a ``LookupError`` when
371 you attempt to delete a nonexistent message from the message store.
372 * ``ISubscriptionService.find_members()`` accepts asterisks as wildcards in
373 the ``subscriber`` argument string. Given by Aurélien Bompard.
374 * ``ISubscriptionService`` now supports mass unsubscribes. Given by Harshit
379 * New DMARC mitigations have been added. Given by Mark Sapiro. (Closes #247)
380 * New placeholders have been added for message headers and footers. You can
381 use a placeholder of the format ``$<archiver-name>_url`` to insert the
382 permalink to the message in the named archiver, for any archiver enabled
383 for the mailing list. Given by Abhilash Raj.
384 * The default posting chain has been modified so that the header-match chain
385 and nonmember-moderation rule are processed before "hold" rules are
386 processed. This allows for better anti-spam defenses and rejecting
387 non-member posts instead of always holding them for moderator review.
388 Given by Aurélien Bompard. (Closes #163)
389 * Bounces can now contain rejection messages. Given by Aurélien Bompard.
390 * The ``moderation_action`` for members and nonmember can now be ``None``
391 which signals falling back to the appropriate list default action,
392 e.g. ``default_member_action`` and ``default_nonmember_action``. Given by
393 Aurélien Bompard. (Closes #189)
394 * Ensure that postings from alternative emails aren't held for moderator
395 approval. For example, if a user is subscribed with one email but posts
396 with a second email that they control, the message should be processed as
397 a posting from a member. Given by Aditya Divekar. (Closes #222)
398 * The default message footer has been improved to include a way to
399 unsubscribe via the ``-leave`` address. Given by Francesco Ariis.
403 * REST API version 3.1 introduced. Mostly backward compatible with version
404 3.0 except that UUIDs are represented as hex strings instead of 128-bit
405 integers, since the latter are not compatible with all versions of
406 JavaScript. (Closes #121)
407 * REST clients must minimally support HTTP/1.1. (Closes #288)
408 * Experimental Gunicorn support. See ``contrib/gunicorn.py`` docstring for
409 details. With assistance from Eric Searcy. (Closes #287)
410 * The new template system is introduced for API 3.1. See
411 ``src/mailman/rest/docs/templates.rst`` for details. (Closes #249)
412 * When creating a user via REST using an address that already exists, but
413 isn't linked, the address is linked to the new user. Given by Aurélien
415 * The REST API incorrectly parsed ``is_server_owner`` values when given
416 explicitly in the POST that creates a user. (Closes #136)
417 * A new top-level resource ``<api>/owners`` can be used to get the list of
418 server owners as ``IUser`` s. (Closes #135)
419 * By POSTing to a user resource with an existing unlinked address, you can
420 link the address to the user. Given by Abhilash Raj.
421 * Fix pagination values ``start`` and ``total_size`` in the REST API. Given
422 by Aurélien Bompard. (Closes: #154)
423 * JSON representations for held message now include a ``self_link``.
424 * When ``[devmode]enabled`` is set, the JSON output is sorted. Given by
426 * A member's moderation action can be changed via the REST API. Given by
428 * Fixed a number of corner cases for the return codes when PUTing or PATCHing
429 list configuration variables. (Closes: #182)
430 * Expose ``digest_send_periodic``, ``digest_volume_frequency``, and
431 ``digests_enabled`` (renamed from ``digestable``) to the REST API.
433 * Expose the "bump digest" and "send digest" functionality though the REST
434 API via the ``<api>/lists/<list-id>/digest`` end-point. GETting this
435 resource returns the ``next_digest_number`` and ``volume`` as the same
436 values accessible through the list's configuraiton resource. POSTing to
437 the resource with either ``send=True``, ``bump=True``, or both invokes the
439 * Global and list-centric bans can now be managed through the REST API.
440 Given by Aurélien Bompard.
441 * ``<api>/members/find`` accepts GET query parameters in addition to POST
442 arguments. Given by Aurélien Bompard.
443 * Header match rules for individual mailing lists are now exposed in the REST
444 API. Given by Aurélien Bompard. (Closes: #192)
445 * Expose ``goodbye_message_uri`` in the REST API. Given by Harshit Bansal.
446 * New subscription requests are rejected if there is already one pending.
447 With thanks to Anirudh Dahiya. (Closes #199)
448 * Expose the system pipelines and chains via ``<api>/system/pipelines`` and
449 ``<api>/system/chains`` respectively. Given by Simon Hanna. (Closes #66)
450 * Support mass unsubscription of members via ``DELETE`` on the
451 ``<api>/lists/<list-id>/roster/member`` resource. Given by Harshit
452 Bansal. (Closes #171)
453 * It is now possible to merge users when creating them via REST. When you
454 POST to ``<api>/users/<address>/addresses`` and the address given in the
455 ``email`` parameter already exists, instead of getting a 400 error, if you
456 set ``absorb_existing=True`` in the POST data, the existing user will be
457 merged into the newly created on. Given by Aurélien Bompard.
458 * Port to Falcon 1.0 (Closes #20)
459 * A member's ``moderation_action`` can be reset, allowing fallback to the
460 list's ``default_member_action`` by setting the attribute to the empty
461 string in the REST API. Given by Aurélien Bompard.
462 * A list's ``moderator_password`` can be set via the REST API. Given by
463 Andrew Breksa. (Closes #207)
464 * The ban manager now returns a pageable, sorted sequence. Given by Amit and
465 Aurélien Bompard. (Closes #284)
466 * Query parameters now allow you to filter mailing lists by the
467 ``advertised`` boolean parameter. Given by Aurélien Bompard.
468 * Only the system-enabled archivers are returned in the REST API. Given by
470 * **Backward incompatibility: mild** Held message resources now have an
471 ``original_subject`` key which is the raw value of the ``Subject:`` header
472 (i.e. without any RFC 2047 decoding). The ``subject`` key is RFC 2047
473 decoded. Given by Simon Hanna. (Closes #219)
477 * Add official support for Python 3.5 and 3.6. (Closes #295)
478 * A handful of unused legacy exceptions have been removed. The redundant
479 ``MailmanException`` has been removed; use ``MailmanError`` everywhere.
480 * Drop the use of the ``lazr.smtptest`` library, which is based on the
481 asynchat/asyncore-based smtpd.py stdlib module. Instead, use the
482 asyncio-based `aiosmtpd <http://aiosmtpd.readthedocs.io/>`_ package.
483 * Improvements in importing Mailman 2.1 lists, given by Aurélien Bompard.
484 * The ``prototype`` archiver is not web accessible so it does not have a
485 ``list_url`` or permalink. Given by Aurélien Bompard.
486 * Large performance improvement in ``SubscriptionService.find_members()``.
487 Given by Aurélien Bompard.
488 * Rework the digest machinery, and add a new ``digests`` subcommand, which
489 can be used from the command line or cron to immediately send out any
490 partially collected digests, or bump the digest and volume numbers.
491 * The mailing list "data directory" has been renamed. Instead of using the
492 fqdn listname, the subdirectory inside ``[paths]list_data_dir`` now uses
494 * The ``mailman members`` command can now be used to display members based on
495 subscription roles. Also, the positional "list" argument can now accept
496 list names or list-ids.
497 * Unsubscriptions can now be confirmed and/or moderated. (Closes #213)
500 3.0.0 -- "Show Don't Tell"
501 ==========================
506 * Domains now have a list of owners, which are ``IUser`` objects, instead of
507 the single ``contact_address`` they used to have. ``IUser`` objects now
508 also have a ``is_server_owner`` flag (defaulting to False) to indicate
509 whether they have superuser privileges. Give by Abhliash Raj, with fixes
510 and refinements by Barry Warsaw. (LP: #1423756)
511 * Mailing list subscription policy work flow has been completely rewritten.
512 It now properly supports email verification and subscription confirmation
513 by the user, and approval by the moderator using unique tokens.
514 ``IMailingList`` objects now have a ``subscription_policy`` attribute.
516 * Port the REST machinery to Falcon 0.3. (LP: #1446881)
520 * Fix calculation of default configuration file to use when the ``$var_dir``
521 is created by ``mailman start``. (LP: #1411435)
522 * When creating a user with an email address, do not create the user record
523 if the email address already exists. Given by Andrew Stuart.
525 * When deleting a user via REST, make sure all linked addresses are deleted.
526 Found by Andrew Stuart. (LP: #1419519)
527 * When trying to subscribe an address to a mailing list through the REST API
528 where a case-differing version of the address is already subscribed, return
529 a 409 error instead of a 500 error. Found by Ankush Sharma. (LP: #1425359)
530 * ``mailman lists --domain`` was not properly handling its arguments. Given
531 by Manish Gill. (LP: #1166911)
532 * When deleting a user object, make sure their preferences are also deleted.
533 Given by Abhishek. (LP: #1418276)
534 * Be sure a mailing list's acceptable aliases are deleted when the mailing
535 list itself is deleted. (LP: #1432239)
536 * The built-in example ``IArchiver`` implementations now explicitly return
538 * The test suite now runs successfully again with PostgreSQL. Given by
539 Aurélien Bompard. (LP: #1435941)
543 * When specifying a file system path in the [paths.*] section, $cfg_file can
544 be used to expand into the path of the ``-C`` option if given. In the
545 default ``[paths.dev]`` section, ``$var_dir`` is now specified relative to
546 ``$cfg_file`` so that it won't accidentally be relative to the current
547 working directory, if ``-C`` is given.
548 * ``$cwd`` is now an additional substitution variable for the ``mailman.cfg``
549 file's ``[paths.*]`` sections. A new ``[paths.here]`` section is added,
550 which puts the ``var_dir`` in ``$cwd``. It is made the default layout.
554 * Improve the documentation describing how to run Alembic to add new schema
555 migrations. Given by Abhilash Raj.
559 * **Backward incompatible change**: The JSON representation for pending
560 mailing list subscription hold now no longer includes the ``password``
561 key. Also, the ``address`` key has been renamed ``email`` for consistent
562 terminology and other usage.
563 * You can now view the contents of, inject messages into, and delete messages
564 from the various queue directories via the ``<api>/queues`` resource.
565 * You can now DELETE an address. If the address is linked to a user, the
566 user is not delete, it is just unlinked.
567 * A new API is provided to support non-production testing infrastructures,
568 allowing a client to cull all orphaned UIDs via ``DELETE`` on
569 ``<api>/reserved/uids/orphans``. Note that *no guarantees* of API
570 stability will ever be made for resources under ``reserved``.
572 * Domains can now optionally be created with owners; domain owners can be
573 added after the fact; domain owners can be deleted. Also, users now have
574 an ``is_server_owner`` flag as part of their representation, which defaults
575 to False, and can be PUT and PATCH'd. Given by Abhilash Raj, with fixes
576 and refinements by Barry Warsaw. (LP: #1423756)
579 3.0 beta 5 -- "Carve Away The Stone"
580 ====================================
585 * Fixed Unicode errors in the digest runner and when sending messages to the
586 site owner as a fallback. Given by Aurélien Bompard. (LP: #1130957).
587 * Fixed Unicode errors when a message being added to the digest has non-ascii
588 characters in its payload, but no Content-Type header defining a charset.
589 Given by Aurélien Bompard. (LP: #1170347)
590 * Fixed messages without a `text/plain` part crashing the `Approved` rule.
591 Given by Aurélien Bompard. (LP: #1158721)
592 * Fixed getting non-ASCII filenames from RFC 2231 i18n'd messages. Given by
593 Aurélien Bompard. (LP: #1060951)
594 * Fixed `AttributeError` on MIME digest messages. Given by Aurélien Bompard.
599 * The `mailman conf` command no longer takes the `-t/--sort` option; the
600 output is always sorted.
604 * The ``[database]migrations_path`` setting is removed.
608 * The ORM layer, previously implemented with Storm, has been replaced by
609 SQLAlchemy, thanks to the fantastic work by Abhilash Raj and Aurélien
610 Bompard. Alembic is now used for all database schema migrations.
611 * The new logger `mailman.database` logs any errors at the database layer.
615 * Python 3.4 is now the minimum requirement.
616 * You no longer have to create a virtual environment separately when running
617 the test suite. Just use `tox`.
618 * You no longer have to edit `src/mailman/testing/testing.cfg` to run the
619 test suite against PostgreSQL. See `src/mailman/docs/START.rst` for
624 * The RFC 2369 headers added to outgoing messages are now added in sorted
626 * Several changes to the internal API:
628 - `IListManager.mailing_lists` is guaranteed to be sorted in List-ID order.
629 - `IDomains.mailing_lists` is guaranteed to be sorted in List-ID order.
630 - Iteration over domains via the `IDomainManager` is guaranteed to be sorted
631 by `IDomain.mail_host` order.
632 - `ITemporaryDatabase` interface and all implementations are removed.
636 * The Falcon Framework has replaced restish as the REST layer. This is an
637 internal change only.
638 * The JSON representation `http_etag` key uses an algorithm that is
639 insensitive to Python's dictionary sort order.
640 * The address resource now has an additional '/user' sub-resource which can
641 be used to GET the address's linked user if there is one. This
642 sub-resource also supports POST to link an unlinked address (with an
643 optional 'auto_create' flag), and PUT to link the address to a different
644 user. It also supports DELETE to unlink the address. (LP: #1312884)
645 Given by Aurélien Bompard based on work by Nicolas Karageuzian.
646 * The ``/3.0/system`` path is deprecated; use ``/3.0/system/versions`` to get
647 the system version information.
648 * You can access the system configuration via the resource path
649 ``/3.0/system/configuration/<section>``. This returns a dictionary with
650 the keys being the section's variables and the values being their value
651 from ``mailman.cfg`` as verbatim strings. You can get a list of all
652 section names via ``/3.0/system/configuration`` which returns a dictionary
653 containing the ``http_etag`` and the section names as a sorted list under
654 the ``sections`` key. The system configuration resource is read-only.
655 * Member resource JSON now include the ``member_id`` as a separate key.
658 3.0 beta 4 -- "Time and Motion"
659 ===============================
664 * Mailman 3 no longer uses ``zc.buildout`` and tests are now run by the
665 ``nose2`` test runner. See ``src/mailman/docs/START.rst`` for details on
666 how to build Mailman and run the test suite. Also, use ``-P`` to select a
667 test pattern and ``-E`` to enable stderr debugging in runners.
668 * Use the ``enum34`` package instead of ``flufl.enum``.
669 * Use ``setuptools`` instead of ``distribute``, since the latter is defunct.
673 * Add ``reply_to_address`` and ``first_strip_reply_to`` as writable
674 attributes of a mailing list's configuration. (LP: #1157881)
675 * Support pagination of some large collections (lists, users, members).
676 [Florian Fuchs] (LP: #1156529)
677 * Expose ``hide_address`` to the ``.../preferences`` REST API.
678 [Sneha Priscilla.] (LP: #1203519)
679 * Mailing lists can now individually enable or disable any archiver available
680 site-wide. [Joanna Skrzeszewska] (LP: #1158040)
681 * Addresses can be added to existing users, including display names, via the
682 REST API. [Florian Fuchs]
683 * Fixed a crash in the REST server when searching for nonmembers via
684 ``/find`` which we've never seen before, because those members only have an
685 address record, not a user record. This requires a small change in the API
686 where the JSON response's ``address`` key now contains the URL to the
687 address resource, the new ``email`` key contains the email address as a
688 string, and the ``user`` key is optional.
692 * `mailman conf` now has a `-t/--sort` flag which sorts the output by section
693 and then key. [Karl-Aksel Puulmann and David Soto] (LP: 1162492)
694 * Greatly improve the fidelity of the Mailman 2.1 list importer functionality
695 (i.e. ``mailman import21``). [Aurélien Bompard].
699 * Add support for the Exim 4 MTA. [Stephen Turnbull]
700 * When creating the initial file system layout in ``var``, e.g. via
701 ``bin/mailman info``, add an ``var/etc/mailman.cfg`` file if one does not
702 already exist. Also, when initializing the system, look for that file as
703 the configuration file, just after ``./mailman.cfg`` and before
704 ``~/.mailman.cfg``. (LP: #1157861)
708 * The `bounceevent` table now uses list-ids to cross-reference the mailing
709 list, to match other tables. Similarly for the `IBounceEvent` interface.
710 * Added a `listarchiver` table to support list-specific archivers.
714 * Non-queue runners should not create ``var/queue`` subdirectories.
715 [Sandesh Kumar Agrawal] (LP: #1095422)
716 * Creation of lists with upper case names should be coerced to lower case.
718 * Fix REST server crash on `mailman reopen` due to no interception of
719 signals. (LP: #1184376)
720 * Add `subject_prefix` to the `IMailingList` interface, and clarify the
721 docstring for `display_name`. (LP: #1181498)
722 * Fix importation from MM2.1 to MM3 of the archive policy.
723 [Aurélien Bompard] (LP: #1227658)
724 * Fix non-member moderation rule to prefer a member sender if both members
725 and non-members are in the message's sender list. [Aurélien Bompard]
727 * Fix IntegrityError (against PostgreSQL) when deleting a list with content
728 filters. [Aurélien Bompard] (LP: #1117174)
729 * Fix test isolation bug in ``languages.rst``.
730 [Piotr Kasprzyk] (LP: #1308769)
733 3.0 beta 3 -- "Here Again"
734 ==========================
739 * Python 2.7 is now required. Python 2.6 is no longer officially supported.
740 The code base is now also `python2.7 -3` clean, although there are still
741 some warnings in 3rd party dependencies. (LP: #1073506)
745 * **API change**: The JSON representation for held messages no longer
746 includes the `data` key. The values in this dictionary are flatted into
747 the top-level JSON representation. The `key` key is remove since it's
748 redundant. Use `message_id` for held messages, and `address` for held
749 subscriptions/unsubscriptions. The following `_mod_*` keys are inserted
750 without the `_mod_` prefix:
752 - `_mod_subject` -> `subject`
753 - `_mod_hold_date` -> `hold_date`
754 - `_mod_reason` -> `reason`
755 - `_mod_sender` -> `sender`
756 - `_mod_message_id` -> `message_id`
758 * List styles are supported through the REST API. Get the list of available
759 styles (by name) via `.../lists/styles`. Create a list in a specific style
760 by using POST data `style_name=<style>`. (LP: #975692)
761 * Allow the getting/setting of IMailingList.subject_prefix via the REST API
762 (given by Terri Oda). (LP: #1062893)
763 * Expose a REST API for membership change (subscriptions and unsubscriptions)
764 moderation. (LP: #1090753)
765 * Add list_id to JSON representation for a mailing list (given by Jimmy
767 * The canonical resource for a mailing list (and thus its self_link) is now
768 the URL with the list-id. To reference a mailing list, the list-id url is
769 preferred, but for backward compatibility, the posting address is still
771 * You can now PUT and PATCH on user resources to change the user's display
772 name or password. For passwords, you pass in the clear text password and
773 Mailman will hash it before storing.
774 * You can now verify and unverify an email address through the REST API.
775 POST to .../addresses/<email>/verify and .../addresses/<email>/unverify
776 respectively. The POST data is ignored. It is not an error to verify or
777 unverify an address more than once, but verifying an already verified
778 address does not change its `.verified_on` date. (LP: #1054730)
779 * Deleting a user through the REST API also deletes all the user's linked
780 addresses and memberships. (LP: #1074374)
781 * A user's password can be verified by POSTing to .../user/<id>/login. The
782 data must contain a single parameter `cleartext_password` and if this
783 matches, a 204 (No Content) will be returned, otherwise a 403 (Forbidden)
784 is returned. (LP: #1065447)
788 * `[passlib]path` configuration variable renamed to `[passlib]configuration`.
789 * Postfix-specific configurations in the `[mta]` section are moved to a
790 separate file, named by the `[mta]configuration` variable.
791 * In the new `postfix.cfg` file, `postfix_map_cmd` is renamed to
793 * The default list style is renamed to `legacy-default` and a new
794 `legacy-announce` style is added. This is similar to the `legacy-default`
795 except set up for announce-only lists.
799 * The `ban` table now uses list-ids to cross-reference the mailing list,
800 since these cannot change even if the mailing list is moved or renamed.
801 * The following columns were unused and have been removed:
803 - `mailinglist.new_member_options`
804 - `mailinglist.send_reminders`
805 - `mailinglist.subscribe_policy`
806 - `mailinglist.unsubscribe_policy`
807 - `mailinglist.subscribe_auto_approval`
808 - `mailinglist.private_roster`
809 - `mailinglist.admin_member_chunksize`
813 * The `IBanManager` is no longer a global utility. Instead, you adapt an
814 `IMailingList` to an `IBanManager` to manage the bans for a specific
815 mailing list. To manage the global bans, adapt ``None``.
819 * `bin/mailman aliases` loses the `--output`, `--format`, and `--simple`
820 arguments, and adds a `--directory` argument. This is necessary to support
821 the Postfix `relay_domains` support.
822 * `bin/mailman start` was passing the wrong relative path to its runner
823 subprocesses when -C was given. (LP: #982551)
824 * `bin/runner` command has been simplified and its command line options
825 reduced. Now, only one `-r/--runner` option may be provided and the
826 round-robin feature has been removed.
830 * Added support for Postfix `relay_domains` setting for better virtual domain
831 support. [Jimmy Bergman].
832 * Two new events are triggered on membership changes: `SubscriptionEvent`
833 when a new member joins a mailing list, and an `UnsubscriptionEvent` when a
834 member leaves a mailing list. (LP: #1047286)
835 * Improve the --help text for the `start`, `stop`, `restart`, and `reopen`
836 subcommands. (LP: #1035033)
840 * Fixed `send_goodbye_message()`. (LP: #1091321)
841 * Fixed REST server crash on `reopen` command. Identification and test
842 provided by Aurélien Bompard. (LP: #1184376)
845 3.0 beta 2 -- "Freeze"
846 ======================
851 * The link between members and the mailing lists they are subscribed to, is
852 now via the RFC 2369 `list_id` instead of the fqdn listname (i.e. posting
853 address). This is because while the posting address can change if the
854 mailing list is moved to a new server, the list id is fixed.
857 - IListManager.get_by_list_id() added.
858 - IListManager.list_ids added.
859 - IMailingList.list_id added.
860 - Several internal APIs that accepted fqdn list names now require list ids,
861 e.g. ISubscriptionService.join() and .find_members().
862 - IMember.list_id attribute added; .mailing_list is now an alias that
863 retrieves and returns the IMailingList.
865 * `passlib`_ is now used for all password hashing instead of flufl.password.
866 The default hash is `sha512_crypt`. (LP: #1015758)
867 * Internally, all datetimes are kept in the UTC timezone, however because of
868 LP: #280708, they are stored in the database in naive format.
869 * `received_time` is now added to the message metadata by the LMTP runner
870 instead of by `Switchboard.enqueue()`. This latter no longer depends on
871 `received_time` in the metadata.
872 * The `ArchiveRunner` no longer acquires a lock before it calls the
873 individual archiver implementations, since not all of them need a lock. If
874 they do, the implementations must acquire said lock themselves.
875 * The `news` runner and queue has been renamed to the more accurate `nntp`.
876 The runner has also been ported to Mailman 3 (LP: #967409). Beta testers
877 can safely remove `$var_dir/queue/news`.
878 * A mailing list's *moderator password* is no longer stored in the clear; it
879 is hashed with the currently selected scheme.
880 * An `AddressVerificationEvent` is triggered when an `IAddress` is verified
881 or unverified. (LP: #975698)
882 * A `PasswordChangeEvent` is triggered when an `IUser`'s password changes.
884 * When a queue runner gets an exception in its _dispose() method, a
885 `RunnerCrashEvent` is triggered, which contains references to the queue
886 runner, mailing list, message, metadata, and exception. Interested parties
887 can subscribe to that `zope.event` for notification.
888 * Events renamed and moved:
889 * `mailman.chains.accept.AcceptNotification`
890 * `mailman.chains.base.ChainNotification`
891 * `mailman.chains.discard.DiscardNotification`
892 * `mailman.chains.hold.HoldNotification`
893 * `mailman.chains.owner.OwnerNotification`
894 * `mailman.chains.reject.RejectNotification`
895 changed to (respectively):
896 * `mailman.interfaces.chains.AcceptEvent`
897 * `mailman.interfaces.chains.ChainEvent`
898 * `mailman.interfaces.chains.DiscardEvent`
899 * `mailman.interfaces.chains.HoldEvent`
900 * `mailman.interfaces.chains.AcceptOwnerEvent`
901 * `mailman.interfaces.chains.RejectEvent`
902 * A `ConfigurationUpdatedEvent` is triggered when the system-wide global
903 configuration stack is pushed or popped.
904 * The policy for archiving has now been collapsed into a single enum, called
905 ArchivePolicy. This describes the three states of never archive, archive
906 privately, and archive_publicly. (LP: #967238)
910 * Schema migrations (LP: #971013)
912 - mailinglist.include_list_post_header -> allow_list_posts
913 - mailinglist.news_prefix_subject_too -> nntp_prefix_subject_too
914 - mailinglist.news_moderation -> newsgroup_moderation
915 - mailinglist.archive and mailinglist.archive_private have been collapsed
917 - mailinglist.nntp_host has been removed.
918 - mailinglist.generic_nonmember_action has been removed (LP: #975696)
920 * Schema migrations (LP: #1024509)
921 - member.mailing_list -> list_id
922 * The PostgreSQL port of the schema accidentally added a moderation_callback
923 column to the mailinglist table. Since this is unused in Mailman, it was
924 simply commented out of the base schema for PostgreSQL.
928 * Expose `archive_policy` in the REST API. Contributed by Alexander
929 Sulfrian. (LP: #1039129)
933 * New configuration variables `clobber_date` and `clobber_skew` supported in
934 every `[archiver.<name>]` section. These are used to determine under what
935 circumstances a message destined for a specific archiver should have its
936 `Date:` header clobbered. (LP: #963612)
937 * With the switch to `passlib`_, `[passwords]password_scheme` has been
938 removed. Instead use `[passwords]path` to specify where to find the
939 `passlib.cfg` file. See the comments in `schema.cfg` for details.
940 * Configuration schema variable changes:
941 * [nntp]username -> [nntp]user
943 * Header check specifications in the `mailman.cfg` file have changed quite
944 bit. The previous `[spam.header.foo]` sections have been removed.
945 Instead, there's a new `[antispam]` section that contains a `header_checks`
946 variable. This variable takes multiple lines of `Header: regexp` values,
947 one per line. There is also a new `jump_chain` variable which names the
948 chain to jump to should any of the header checks (including the
949 list-specific, and programmatically added ones) match.
953 * Some additional documentation on related components such as Postorius and
954 hyperkitty have been added, given by Stephen J Turnbull.
958 * Fixed the RFC 1153 digest footer to be compliant. (LP: #887610)
959 * Fixed a UnicodeError with non-ascii message bodies in the `approved` rule,
960 given by Mark Sapiro. (LP: #949924)
961 * Fixed a typo when returning the configuration file's header match checks.
963 * List-Post should be NO when posting is not allowed. (LP: #987563)
964 * Non-unicode values in msgdata broke pending requests. (LP: #1031391)
965 * Show devmode in `bin/mailman info` output. (LP: #1035028)
966 * Fix residual references to the old `IMailingList` archive variables.
969 .. _`passlib`: http://packages.python.org/passlib/index.html
972 3.0 beta 1 -- "The Twilight Zone"
973 =================================
978 * Schema migrations have been implemented.
979 * Implement the style manager as a utility instead of an attribute hanging
980 off the `mailman.config.config` object.
981 * PostgreSQL support contributed by Stephen A. Goss. (LP: #860159)
982 * Separate out the RFC 2369 header adding handler.
983 * Dynamically calculate the `List-Id` header instead of storing it in the
984 database. This means it cannot be changed.
985 * Major redesign of the template search system, fixing LP: #788309. $var_dir
986 is now used when search for all template overrides, site, domain, or
987 mailing list. The in-tree English templates are used only as a last
989 * Support downloading templates by URI, including mailman:// URIs. This is
990 used in welcome and goodbye messages, as well as regular and digest headers
991 and footers, and supports both language and mailing list specifications.
992 E.g. mailman:///test@example.com/it/welcome.txt
993 * $user_password is no longer supported as a placeholder in headers and
995 * Mailing lists get multiple chains and pipelines. For example, normal
996 postings go through the `posting_chain` while messages to owners to through
997 `owners_chain`. The default `built-in` chain is renamed to
998 `default-posting-chain` while the `built-in` pipeline is renamed
999 `default-posting-pipeline`.
1000 * The experimental `maildir` runner is removed. Use LMTP.
1001 * The LMTP server now requires that the incoming message have a `Message-ID`,
1002 otherwise it rejects the message with a 550 error. Also, the LMTP server
1003 adds the `X-Message-ID-Hash` header automatically. The `inject` cli
1004 command will also add the `X-Message-ID-Hash` header, but it will craft a
1005 `Message-ID` header first if one is missing from the injected text. Also,
1006 `inject` will always set the correct value for the `original_size`
1007 attribute on the message object, instead of trusting a possibly incorrect
1008 value if it's already set. The individual `IArchiver` implementations no
1009 longer set the `X-Message-ID-Hash` header.
1010 * The Prototype archiver now stores its files in maildir format inside of
1011 `$var_dir/archives/prototype`, given by Toshio Kuratomi.
1012 * Improved "8 mile high" document distilled by Stephen J Turnbull from the
1013 Pycon 2012 Mailman 3 sprint. Also improvements to the Sphinx build given
1014 by Andrea Crotti (LP: #954718).
1015 * Pipermail has been eradicated.
1016 * Configuration variable `[mailman]filtered_messages_are_preservable`
1017 controls whether messages which have their top-level `Content-Type`
1018 filtered out can be preserved in the `bad` queue by list owners.
1019 * Configuration section `[scrubber]` removed, as is the scrubber handler.
1020 This handler was essentially incompatible with Mailman 3 since it required
1021 coordination with Pipermail to store attachments on disk.
1026 - welcome_msg -> welcome_message_uri
1027 - goodbye_msg -> goodbye_message_uri
1028 - send_welcome_msg -> send_welcome_message
1029 - send_goodbye_msg -> send_goodbye_message
1030 - msg_header -> header_uri
1031 - msg_footer -> footer_uri
1032 - digest_header -> digest_header_uri
1033 - digest_footer -> digest_footer_uri
1034 - start_chain -> posting_chain
1035 - pipeline -> posting_pipeline
1036 - real_name -> display_name (mailinglist, user, address)
1038 - mailinglist.filter_action
1039 - mailinglist.owner_chain
1040 - mailinglist.owner_pipeline
1044 * Held messages can now be moderated through the REST API. Mailing list
1045 resources now accept a `held` path component. GETing this returns all held
1046 messages for the mailing list. POSTing to a specific request id under this
1047 url can dispose of the message using `Action` enums.
1048 * Mailing list resources now have a `member_count` attribute which gives the
1049 number of subscribed members. Given by Toshio Kuratomi.
1053 * Add property `IUserManager.members` to return all `IMembers` in the system.
1054 * Add property `IListmanager.name_components` which returns 2-tuples for
1055 every mailing list as (list_name, mail_host).
1056 * Remove previously deprecated `IListManager.get_mailing_lists()`.
1057 * `IMailTransportAgentAliases` now explicitly accepts duck-typed arguments.
1058 * `IRequests` interface is removed. Now just use adaptation from
1059 `IListRequests` directly (which takes an `IMailingList` object).
1060 * `handle_message()` now allows for `Action.hold` which is synonymous with
1061 `Action.defer` (since the message is already being held).
1062 * `IListRequests.get_request()` now takes an optional `request_type`
1063 argument to narrow the search for the given request.
1064 * New `ITemplateLoader` utility.
1065 * `ILanguageManager.add()` returns the `ILanguage` object just created.
1066 * `IMailinglist.decorators` removed; it was unused
1067 * `IMailingList.real_name` -> `IMailingList.display_name`
1068 * `IUser.real_name` -> `IUser.display_name`
1069 * `IAddress.real_name` -> `IAddress.display_name`
1070 * Add property `IRoster.member_count`.
1074 * IPython support in `bin/mailman shell` contributed by Andrea Crotti.
1076 * The `mailman.cfg` configuration file will now automatically be detected if
1077 it exists in an `etc` directory which is a sibling of argv0.
1078 * `bin/mailman shell` is an alias for `withlist`.
1079 * The `confirm` email command now properly handles `Re:`-like prefixes, even
1080 if they contain non-ASCII characters. (LP: #685261)
1081 * The `join` email command no longer accepts an `address=` argument. Its
1082 `digest=` argument now accepts the following values: `no` (for regular
1083 delivery), `mime`, or `plain`.
1084 * Added a `help` email command.
1085 * A welcome message is sent when the user confirms their subscription via
1087 * Global ``-C`` option now accepts an absolute path to the configuration
1088 file. Given by Andrea Crotti. (LP: #953707)
1092 * Subscription disabled probe warning notification messages are now sent
1093 without a `Precedence:` header. Given by Mark Sapiro. (LP: #808821)
1094 * Fixed KeyError in retry runner, contributed by Stephen A. Goss.
1096 * Fixed bogus use of `bounce_processing` attribute (should have been
1097 `process_bounces`, with thanks to Vincent Fretin. (LP: #876774)
1098 * Fix `test_moderation` for timezones east of UTC+0000, given by blacktav.
1102 3.0 alpha 8 -- "Where's My Thing?"
1103 ==================================
1108 * Factor out bounce detection to `flufl.bounce`.
1109 * Unrecognized bounces can now also be forwarded to the site owner.
1110 * mailman.qrunner log is renamed to mailman.runner
1111 * master-qrunner.lck -> master.lck
1112 * master-qrunner.pid -> master.pid
1113 * Four new events are created, and notifications are sent during mailing list
1115 - ListCreatingEvent - sent before the mailing list is created
1116 - ListCreatedEvent - sent after the mailing list is created
1117 - ListDeletingEvent - sent before the mailing list is deleted
1118 - ListDeletedEvent - sent after the mailing list is deleted
1119 * Four new events are created, and notifications are sent during domain
1121 - DomainCreatingEvent - sent before the domain is created
1122 - DomainCreatedEvent - sent after the domain is created
1123 - DomainDeletingEvent - sent before the domain is deleted
1124 - DomainDeletedEvent - sent after the domain is deleted
1125 * Using the above events, when a domain is deleted, associated mailing lists
1126 are deleted. (LP: #837526)
1127 * IDomain.email_host -> .mail_host (LP: #831660)
1128 * User and Member ids are now proper UUIDs.
1129 * Improved the way enums are stored in the database, so that they are more
1130 explicitly expressed in the code, and more database efficient.
1134 * Preferences for addresses, users, and members can be accessed, changed, and
1135 deleted through the REST interface. Hierarchical, combined preferences for
1136 members, and system preferences can be read through the REST interface.
1138 * The IMailingList attribute ``host_name`` has been renamed to ``mail_host``
1139 for consistency. This changes the REST API for mailing list
1140 resources. (LP: #787599)
1141 * New REST resource http://.../members/find can be POSTed to in order to find
1142 member records. Optional arguments are `subscriber` (email address to
1143 search for), `fqdn_listname`, and `role` (i.e. MemberRole). (LP: #799612)
1144 * You can now query or change a member's `delivery_mode` attribute through
1145 the REST API (LP: #833132). Given by Stephen A. Goss.
1146 * New REST resource http://.../<domain>/lists can be GETed in order to find
1147 all the mailing lists in a specific domain (LP: #829765). Given by
1149 * Fixed /lists/<fqdn_listname>/<role>/<email> (LP: #825570)
1150 * Remove role plurals from /lists/<fqdn_listname/rosters/<role>
1151 * Fixed incorrect error code for /members/<bogus> (LP: #821020). Given by
1153 * DELETE users via the REST API. (LP: #820660)
1154 * Moderators and owners can be added via REST (LP: #834130). Given by
1156 * Getting the roster or configuration of a nonexistent list did not give a
1157 404 error (LP: #837676). Given by Stephen A. Goss.
1158 * PATCHing an invalid attribute on a member did not give a 400 error
1159 (LP: #833376). Given by Stephen A. Goss.
1160 * Getting the memberships for a non-existent address did not give a 404 error
1161 (LP: #848103). Given by Stephen A. Goss.
1165 * `bin/qrunner` is renamed to `bin/runner`.
1166 * `bin/mailman aliases` gains `-f` and `-s` options.
1167 * `bin/mailman create` no longer allows a list to be created with bogus owner
1168 addresses. (LP: #778687)
1169 * `bin/mailman start --force` option is fixed. (LP: #869317)
1173 * Update the COPYING file to contain the GPLv3. (LP: #790994)
1174 * Major terminology change: ban the terms "queue runners" and "qrunners" since
1175 not all runners manage queue directories. Just call them "runners". Also,
1176 the master is now just called "the master runner".
1180 * New configuration variable in [devmode] section, called `wait` which sets
1181 the timeout value used in the test suite for starting up subprocesses.
1182 * Handle SIGTERM in the REST server so that the test suite always shuts down
1183 correctly. (LP: #770328)
1185 Other bugs and changes
1186 ----------------------
1187 * Moderating a message with Action.accept now sends the message. (LP: #827697)
1188 * Fix AttributeError triggered by i18n call in autorespond_to_sender()
1190 * Local timezone in X-Mailman-Approved-At caused test failure. (LP: #832404)
1191 * InvalidEmailAddressError no longer repr()'s its value.
1192 * Rewrote a test for compatibility between Python 2.6 and 2.7. (LP: #833208)
1193 * Fixed Postfix alias file generation when more than one mailing list
1194 exists. (LP: #874929). Given by Vincent Fretin.
1197 3.0 alpha 7 -- "Mission"
1198 ========================
1203 * Significant updates to the subscription model. Members can now subscribe
1204 with a preferred address, and changes to that will be immediately reflected
1205 in mailing list subscriptions. Users who subscribe with an explicit
1206 address can easily change to a different address, as long as that address
1207 is verified. (LP: #643949)
1208 * IUsers and IMembers are now assigned a unique, random, immutable id.
1209 * IUsers now have created_on and .preferred_address properties.
1210 * IMembers now have a .user attribute for easy access to the subscribed user.
1211 * When created with add_member(), passwords are always stored encrypted.
1212 * In all interfaces, "email" refers to the textual email address while
1213 "address" refers to the `IAddress` object.
1214 * mailman.chains.base.Chain no longer self registers.
1215 * New member and nonmember moderation rules and chains. This effectively
1216 ports moderation rules from Mailman 2 and replaces attributes such as
1217 member_moderation_action, default_member_moderation, and
1218 generic_nonmember_action. Now, nonmembers exist as subscriptions on a
1219 mailing list and members have a moderation_action attribute which describes
1220 the disposition for postings from that address.
1221 * Member.is_moderated was removed because of the above change.
1222 * default_member_action and default_nonmember_action were added to mailing
1224 * All sender addresses are registered (unverified) with the user manager by
1225 the incoming queue runner. This way, nonmember moderation rules will
1226 always have an IAddress that they can subscribe to the list (as
1227 MemberRole.nonmember).
1228 * Support for SMTP AUTH added via smtp_user and smtp_pass configuration
1229 variables in the [mta] section. (LP: #490044)
1230 * IEmailValidator interface for pluggable validation of email addresses.
1231 * .subscribe() is moved from the IAddress to the IMailingList
1232 * IAddresses get their registered_on attribute set when the object is created.
1236 * [devmode] section gets a new 'testing' variable.
1237 * Added password_scheme and password_length settings for defining the
1238 default password encryption scheme.
1239 * creator_pw_file and site_pw_file are removed.
1243 * 'bin/mailman start' does a better job of producing an error when Mailman is
1245 * 'bin/mailman status' added for providing command line status on the master
1246 queue runner watcher process.
1247 * 'bin/mailman info' now prints the REST root url and credentials.
1248 * mmsitepass removed; there is no more site password.
1252 * Add Basic Auth support for REST API security. (Jimmy Bergman)
1253 * Include the fqdn_listname and email address in the member JSON
1255 * Added reply_goes_to_list, send_welcome_msg, welcome_msg,
1256 default_member_moderation to the mailing list's writable attributes in the
1257 REST service. (Jimmy Bergman)
1258 * Expose the new membership model to the REST API. Canonical member resource
1259 URLs are now much shorter and live in their own top-level namespace instead
1260 of within the mailing list's namespace.
1261 * /addresses/<email>/memberships gets all the memberships for a given email
1263 * /users is a new top-level URL under which user information can be
1264 accessed. Posting to this creates new users.
1265 * Users can subscribe to mailing lists through the REST API.
1266 * Domains can be deleted via the REST API.
1267 * PUT and PATCH to a list configuration now returns a 204 (No Content).
1271 * Support Python 2.7. (LP: #667472)
1272 * Disable site-packages in buildout.cfg because of LP: #659231.
1273 * Don't include eggs/ or parts/ in the source tarball. (LP: #656946)
1274 * flufl.lock is now required instead of locknix.
1278 * Typo in scan_message(). (LP: #645897)
1279 * Typo in add_member(). (LP: #710182) (Florian Fuchs)
1280 * Re-enable bounce detectors. (LP: #756943)
1281 * Clean up many pyflakes problems; ditching pylint.
1284 3.0 alpha 6 -- "Cut to the Chase"
1285 =================================
1290 * The functionality of 'bin/list_members' has been moved to
1291 'bin/mailman members'.
1292 * 'bin/mailman info' -v/--verbose output displays the file system
1293 layout paths Mailman is currently configured to use.
1297 * You can now configure the paths Mailman uses for queue files, lock files,
1298 data files, etc. via the configuration file. Define a file system 'layout'
1299 and then select that layout in the [mailman] section. Default layouts
1300 include 'local' for putting everything in /var/tmp/mailman, 'dev' for local
1301 development, and 'fhs' for Filesystem Hierarchy Standard 2.3 (LP #490144).
1302 * Queue file directories now live in $var_dir/queues.
1306 * lazr.restful has been replaced by restish as the REST publishing technology
1308 * New REST API for getting all the members of a roster for a specific mailing
1310 * New REST API for getting and setting a mailing list's configuration. GET
1311 and PUT are supported to retrieve the current configuration, and set all
1312 the list's writable attributes in one request. PATCH is supported to
1313 partially update a mailing list's configuration. Individual options can be
1314 set and retrieved by using subpaths.
1315 * Subscribing an already subscribed member via REST now returns a 409 HTTP
1317 * Fixed a bug when deleting a list via the REST API. LP: #601899
1321 * X-BeenThere header is removed.
1322 * Mailman no longer touches the Sender or Errors-To headers.
1323 * Chain actions can now fire Zope events in their _process()
1325 * Environment variable $MAILMAN_VAR_DIR can be used to control the var/
1326 directory for Mailman's runtime files. New environment variable
1327 $MAILMAN_UNDER_MASTER_CONTROL is used instead of the qrunner's --subproc/-s
1332 * Allow X-Approved and X-Approve headers, equivalent to Approved and
1333 Approve. LP: #557750
1334 * Various test failure fixes. LP: #543618, LP: #544477
1335 * List-Post header is retained in MIME digest messages. LP: #526143
1336 * Importing from a Mailman 2.1.x list is partially supported.
1339 3.0 alpha 5 -- "Distant Early Warning"
1340 ======================================
1345 * Add REST API for subscription services. You can now:
1347 - list all members in all mailing lists
1348 - subscribe (and possibly register) an address to a mailing list
1349 - unsubscribe an address from mailing list
1353 * 'bin/dumpdb' is now 'bin/mailman qfile'
1354 * 'bin/unshunt' is now 'bin/mailman unshunt'
1355 * Mailman now properly handles the '-join', '-leave', and '-confirm' email
1356 commands and sub-addresses. '-subscribe' and '-unsubscribe' are aliases
1357 for '-join' and '-leave' respectively.
1361 * devmode settings now live in their own [devmode] section.
1362 * Mailman now searches for a configuration file using this search order. The
1363 first file that exists is used.
1365 - -C config command line argument
1366 - $MAILMAN_CONFIG_FILE environment variable
1372 3.0 alpha 4 -- "Vital Signs"
1373 ============================
1378 * 'bin/inject' is now 'bin/mailman inject', with some changes
1379 * 'bin/mailmanctl' is now 'bin/mailman start|stop|reopen|restart'
1380 * 'bin/mailman version' is added (output same as 'bin/mailman --version')
1381 * 'bin/mailman members' command line arguments have changed. It also
1382 now ignores blank lines and lines that start with #. It also no longer
1383 quits when it sees an address that's already subscribed.
1384 * 'bin/withlist' is now 'bin/mailman withlist', and its command line
1385 arguments have changed.
1386 * 'bin/mailman lists' command line arguments have changed.
1387 * 'bin/genaliases' is now 'bin/mailman aliases'
1391 * A near complete rewrite of the low-level SMTP delivery machinery. This
1392 greatly improves readability, testability, reuse and extensibility. Almost
1393 all the old functionality has been retained. The smtp_direct.py handler is
1395 * Refactor model objects into the mailman.model subpackage.
1396 * Refactor most of the i18n infrastructure into a separate flufl.i18n package.
1397 * Switch from setuptools to distribute.
1398 * Remove the dependency on setuptools_bzr
1399 * Do not create the .mo files during setup.
1403 * All log files now have a '.log' suffix by default.
1404 * The substitution placeholders in the verp_format configuration variable
1406 * Add a devmode configuration variable that changes some basic behavior.
1407 Most importantly, it allows you to set a low-level SMTP recipient for all
1408 mail for testing purposes. See also devmode_recipient.
1411 3.0 alpha 3 -- "Working Man"
1412 ============================
1417 * Configuration is now done through lazr.config. Defaults.py is
1418 dead. lazr.config files are essentially hierarchical ini files.
1419 * Domains are now stored in the database instead of in the configuration file.
1420 * pre- and post- initialization hooks are now available to plugins. Specify
1421 additional hooks to run in the configuration file.
1422 * Add the environment variable $MAILMAN_CONFIG_FILE which overrides the -C
1423 command line option.
1424 * Make LMTP more compliant with Postfix docs (Patrick Koetter)
1425 * Added a NullMTA for mail servers like Exim which just work automatically.
1429 * 'bin/mailman' is a new super-command for managing Mailman from the command
1430 line. Some older bin scripts have been converted, with more to come.
1431 * Mailman now has an administrative REST interface which can be used to get
1432 information from and manage Mailman remotely.
1433 * Back port of Mailman 2.1's limit on .bak file restoration. After 3
1434 restores, the file is moved to the bad queue, with a .psv extension. (Mark
1436 * Digest creation is moved into a new queue runner so it doesn't block main
1441 * bin/make_instance is no longer necessary, and removed
1442 * The debug log is turned up to info by default to reduce log file spam.
1444 Building and installation
1445 -------------------------
1446 * All doc tests can now be turned into documentation, via Sphinx. Just run
1447 bin/docs after bin/buildout.
1450 3.0 alpha 2 -- "Grand Designs"
1451 ==============================
1457 * Mailman 3 is now licensed under the GPLv3.
1462 * Changed bin/arch to attempt to open the mbox before wiping the old
1463 archive. Launchpad bug #280418.
1465 * Added digest.mbox and pending.pck to the 'list' files checked by
1466 check_perms. Launchpad bug #284802.
1471 * Converted to using zope.testing as the test infrastructure. Use bin/test
1472 now to run the full test suite.
1473 <http://pypi.python.org/pypi/zope.testing/3.7.1>
1474 * Partially converted to using lazr.config as the new configuration
1475 regime. Not everything has been converted yet, so some manual editing
1476 of mailman/Defaults.py is required. This will be rectified in future
1477 versions. <http://launchpad.net/lazr.config>
1478 * All web-related stuff is moved to its own directory, effectively moving
1479 it out of the way for now.
1480 * The email command infrastructure has been reworked to play more nicely
1481 with the plug-in architecture. Not all commands have yet been
1487 * The LMTP server now properly calculates the message's original size.
1488 * For command line scripts, -C names the configuration file to use. For
1489 convenient testing, if -C is not given, then the environment variable
1490 MAILMAN_CONFIG_FILE is consulted.
1491 * Support added for a local MHonArc archiver, as well as archiving
1492 automatically in the remote Mail-Archive.com service.
1493 * The permalink proposal for supporting RFC 5064 has been adopted.
1494 * Mailing lists no longer have a .web_page_url attribute; this is taken from
1495 the mailing list's domain's base_url attribute.
1496 * Incoming MTA selection is now taken from the config file instead of
1497 plugins. An MTA for Postfix+LMTP is added. bin/genaliases works again.
1498 * If a message has no Message-ID, the stock archivers will return None for
1499 the permalink now instead of raising an assertion.
1500 * IArchiver no longer has an is_enabled property; this is taken from the
1501 configuration file now.
1506 * Python 2.6 is the minimal requirement.
1507 * Converted to using zc.buildout as the build infrastructure. See
1508 docs/ALPHA.txt for details.
1509 <http://pypi.python.org/pypi/zc.buildout/1.1.1>
1512 3.0 alpha 1 -- "Leave That Thing Alone"
1513 =======================================
1516 User visible changes
1517 --------------------
1519 * So called 'new style' subject prefixing is the default now, and the only
1520 option. When a list's subject prefix is added, it's always done so before
1521 any Re: tag, not after. E.g. '[My List] Re: The subject'.
1522 * RFC 2369 headers List-Subscribe and List-Unsubscribe now use the preferred
1523 -join and -leave addresses instead of the -request address with a subject
1529 * There is no more separate configure; make; make install step. Mailman 3.0
1530 is a setuptools package.
1531 * Mailman can now be configured via a 'mailman.cfg' file which lives in
1532 $VAR_PREFIX/etc. This is used to separate the configuration from the
1533 source directory. Alternative configuration files can be specified via
1534 -C/--config for most command line scripts. mailman.cfg contains Python
1535 code. mm_cfg.py is no more. You do not need to import Defaults.py in
1536 etc/mailman.cfg. You should still consult Defaults.py for the list of site
1537 configuration variables available to you.
1539 See the etc/mailman.cfg.sample file.
1540 * PUBLIC_ARCHIVE_URL and DEFAULT_SUBJECT_PREFIX now takes $-string
1541 substitutions instead of %-string substitutions. See documentation in
1542 Defaults.py.in for details.
1543 * Message headers and footers now only accept $-string substitutions;
1544 %-strings are no longer supported. The substitution variable
1545 '_internal_name' has been removed; use $list_name or $real_name
1546 instead. The substitution variable $fqdn_listname has been added.
1547 DEFAULT_MSG_FOOTER in Defaults.py.in has been updated accordingly.
1548 * The KNOWN_SPAMMERS global variable is replaced with HEADER_MATCHES. The
1549 mailing list's header_filter_rules variable is replaced with header_matches
1550 which has the same semantics as HEADER_MATCHES, but is list-specific.
1551 * DEFAULT_MAIL_COMMANDS_MAX_LINES -> EMAIL_COMMANDS_MAX_LINES
1552 * All SMTP_LOG_* templates use $-strings and all consistently write the
1553 Message-ID as the first item in the log entry.
1554 * DELIVERY_MODULE now names a handler, not a module (yes, this is a
1555 misnomer, but it will likely change again before the final release).
1560 * Internally, all strings are Unicodes.
1561 * Implementation of a chain-of-rules based approach for deciding whether a
1562 message should initially be accepted, held for approval, rejected/bounced,
1563 or discarded. This replaces most of the disposition handlers in the
1564 pipeline. The IncomingRunner now only processes message through the rule
1565 chains, and once accepted, places the message in a new queue processed by
1567 * Substantially reworked the entire queue runner process management,
1568 including mailmanctl, a new master script, and the qrunners. This should
1569 be much more robust and reliable now.
1570 * The Storm ORM is used for data storage, with the SQLite backend as the
1571 default relational database.
1572 * Zope interfaces are used to describe the major components.
1573 * Users are now stored in a unified database, and shared across all mailing
1575 * Mailman's web interface is now WSGI compliant. WSGI is a Python standard
1576 (PEP 333) allowing web applications to be (more) easily integrated with any
1577 number of existing Python web application frameworks. For more information
1580 http://www.wsgi.org/wsgi
1581 http://www.python.org/dev/peps/pep-0333/
1583 Mailman can still be run as a traditional CGI program of course.
1584 * Mailman now provides an LMTP server for more efficient integration with
1585 supporting mail servers (e.g. Postfix, Sendmail). The Local Mail Transport
1586 Protocol is defined in RFC 2033:
1588 http://www.faqs.org/rfcs/rfc2033.html
1589 * Virtual domains are now fully supported in that mailing lists of the same
1590 name can exist in more than one domain. This is accomplished by renaming
1591 the lists/ and archives/ subdirectories after the list's posting address.
1592 For example, data for list foo in example.com and list foo in example.org
1593 will be stored in lists/foo@example.com and lists/foo@example.org.
1595 For Postfix or manual MTA users, you will need to regenerate your mail
1596 aliases. Use bin/genaliases.
1598 VIRTUAL_HOST_OVERVIEW has been removed, effectively Mailman now operates
1599 as if it were always enabled. If your site has more than one domain,
1600 you must configure all domains by using add_domain() in your
1601 etc/mailman.cfg flie (see below -- add_virtual() has been removed).
1602 * If you had customizations based on Site.py, you will need to re-implement
1603 them. Site.py has been removed.
1604 * The site list is no more. You can remove your 'mailman' site list unless
1605 you want to retain it for other purposes, but it is no longer used (or
1606 required) by Mailman. You should set NO_REPLY_ADDRESS to an address that
1607 throws away replies, and you should set SITE_OWNER_ADDRESS to an email
1608 address that reaches the person ultimately responsible for the Mailman
1609 installation. The MAILMAN_SITE_LIST variable has been removed.
1610 * qrunners no longer restart on SIGINT; SIGUSR1 is used for that now.
1612 Internationalization Big Changes
1613 --------------------------------
1615 * Translators should work only on messages/<lang>/LC_MESSAGES/mailman.po.
1616 Templates files are generated from mailman.po during the build process.
1621 * Confirmed member change of address is logged in the 'subscribe' log, and if
1622 admin_notify_mchanges is true, a notice is sent to the list owner using a
1623 new adminaddrchgack.txt template.
1624 * There is a new list attribute 'subscribe_auto_approval' which is a list of
1625 email addresses and regular expressions matching email addresses whose
1626 subscriptions are exempt from admin approval. RFE 403066.
1628 Command line scripts
1629 --------------------
1631 * Most scripts have grown a -C/--config flag to allow you to specify a
1632 different configuration file. Without this, the default etc/mailman.cfg
1634 * the -V/--virtual-host-overview switch in list_lists has been removed, while
1635 -d/--domain and -f/--full have been added.
1636 * bin/newlist is renamed bin/create_list and bin/rmlist is renamed
1637 bin/remove_list. Both take fully-qualified list names now (i.e. the list's
1638 posting address), but also accept short names, in which case the default
1639 domain is used. newlist's -u/--urlhost and -e/--emailhost switches have
1640 been removed. The domain that the list is being added to must already
1642 * Backport the ability to specify additional footer interpolation variables
1643 by the message metadata 'decoration-data' key.
1645 Bug fixes and other patches
1646 ---------------------------
1648 * Removal of DomainKey/DKIM signatures is now controlled by Defaults.py
1649 mm_cfg.py variable REMOVE_DKIM_HEADERS (default = No).
1650 * Queue runner processing is improved to log and preserve for analysis in the
1651 shunt queue certain bad queue entries that were previously logged but lost.
1652 Also, entries are preserved when an attempt to shunt throws an exception
1654 * The processing of Topics regular expressions has changed. Previously the
1655 Topics regexp was compiled in verbose mode but not documented as such which
1656 caused some confusion. Also, the documentation indicated that topic
1657 keywords could be entered one per line, but these entries were not handled
1658 properly. Topics regexps are now compiled in non-verbose mode and multi-
1659 line entries are 'ored'. Existing Topics regexps will be converted when
1660 the list is updated so they will continue to work.
1661 * The List-Help, List-Subscribe, and List-Unsubscribe headers were
1662 incorrectly suppressed in messages that Mailman sends directly to users.
1663 * The 'adminapproved' metadata key is renamed 'moderator_approved'.