Differences between revisions 12 and 61 (spanning 49 versions)
Revision 12 as of 2008-07-14 06:08:08
Size: 8017
Editor: ianeiloart
Comment:
Revision 61 as of 2018-04-20 06:57:02
Size: 1896
Editor: maxking
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
#pragma page-filename DEV/versions/5177349 #pragma page-filename DEV/versions/786622
Line 3: Line 3:
This is where I am collecting the feature list and other artifacts for Mailman 3.0 which will be a major upgrade for the project. Many things that people have been wanting for years will be addressed, most notably a unified user database, true virtual domain support, and backing the Mailman data in a real database layer. From a development perspective, we will be adopting a very strict test-driven development model, utilizing modern Python technology and coding styles. The focus will be on providing core Mailman as a library for easy integration into other frameworks and sites, while continuing the tradition of providing a turnkey solution with all the necessary parts, making it even easier to download, install, and go. Mailman 3.0 was [[https://mail.python.org/pipermail/mailman-announce/2015-April/000210.html|released]] on April 28, 2015. See also the [[Mailman3|release notes]].
Line 5: Line 5:
There is currently no ETA for Mailman 3, but development is moving quickly. Contributors are welcome and encouraged! Discussions will happen on the [[mailto:mailman-developers@python.org|mailman-developers mailing list]]. Anyone can check out and use the [[../MailmanBranches|current development source branches]]. The list below is not a commitment of features (unless marked witha '''Done''' :-) ). Add your own as comments and I will move as appropriate into the wish list. You might also want to consider looking at the much more modest [[../Mailman 2.2|Mailman 2.2]] branch. Contributors are welcome and encouraged! Discussions will happen on the [[mailto:mailman-developers@python.org|mailman-developers mailing list]]. Anyone can check out and use the [[DEV/MailmanBranches|current development source branches]].
Line 7: Line 7:
= To Do List =
Here are things we need to do before MM3 can be released.
== Development and status ==
Mailman 3 is essentially four main projects:
Line 10: Line 10:
 * Defend against runaway .bak file restore loops in the Switchboard.
= (Potential) feature set =
== Compatibility and code cleaning ==
 * '''Python 2.5 or newer is required.'''
 * Switch to email 4 ('''Done''')
 * Use Python's standard [[http://www.python.org/doc/current/lib/module-logging.html|logging]] package throughout. ('''Done''')
 * Convert the last of the string exceptions in Errors.py to class exceptions
 * Remove all unnecessary \''_future''\_ statements ('''Done''')
 * Remove {{{True}}}/{{{False}}} hackery ('''Done''')
 * Fix [[../TestSuite|unit test suite]]! ('''Done''')
 * Eliminate the use of {{{types}}} module as much as possible ('''Done''')
 * Use the [[http://www.python.org/doc/current/lib/module-optparse.html|optparse]] module throughout instead of getopt. ('''Under way''')
 * Use the [[http://www.python.org/doc/current/lib/module-subprocess.html|subprocess]] module instead of things like {{{os.popen()}}}.
== Wart removal ==
 * Get rid of the "one list per site with the same name" restriction (cf. [[DOC/Virtual domain hosting with Mailman?|FAQ on Virtual domain hosting with Mailman]], Hans Ulrich Niedermann's [[http://nix.lauft.net/mailman/|vhost Branch]]) ('''Done''')
 * Easy configuration of list styles.
== Message cleanup ==
 * Strip nodup recipients from both the {{{To}}} and {{{Cc}}} headers, and juggle recipient headers so that the list address is always in the {{{To}}} field. This might address the other major complaint against no-reply-to-munging, recipient proliferation.
== Web U/I ==
A web UI improvement project was undertaken for the [[../Summer of Code|2006 summer of code]]. Although there were good ideas, we didn't end up with anything usable, so we need to coordinate a new u/i subproject.
 * [[https://gitlab.com/mailman/mailman |Mailman Core]]
 * [[DEV/Postorius Web Interface|Postorius - The Web UI for Mailman]] ([[https://gitlab.com/mailman/postorius |code]])
 * [[https://gitlab.com/mailman/mailmanclient | Mailman Client - The REST API Client]]
 * [[HyperKitty|HyperKitty - The Archiver for Mailman]] ([[https://gitlab.com/mailman/hyperkitty |code]])
Line 31: Line 15:
== Privacy ==
 * Add an option to allow ''verified'' non-members to post to the list. A verified non-member is someone who posts to the list and responds in the affirmative to a confirmation message. A verified member can post in the future (think [[http://www.gmane.org|Gmane]]).
 * Rosters should not be public by default.
 * Get rid of password reminders altogether. Encrypt member passwords and use a password reset feature instead of a reminder. ('''Done''')
== Internationalization ==
 * Clean up our Unicode story! All strings should be Unicode internally, with conversion at the boundaries of the system. IWBNI we could get rid of all the catches of UnicodeErrors, however we may have to make changes to things like the email library.
 * Switch to a new templating system that lets us share templates across languages, but extract messages for the catalog.
 * Finish the transition to [[../Managing Translations|an externally managed translation system]]
 * Switch to $strings (i.e. {{{string.Template}}} instances) for all i18n substitutions. We should be able to mechanically update all existing translations. ('''Under way''')
 * Language variants (e.g. en_UK)
== Spam defenses ==
 * Possibly integrate [[http://www.spambayes.org|Spambayes]] or [[http://www.spamassassin.org|SpamAssassin]].
 * Hook into the [[../LMTP process|LMTP process]] so that messages can be disposed of as early as possible. Check potential senders and recipients at LTMP time. ('''Under way''')
 * Suppress backscatter bounces when [[http://www.openspf.org|SPF]] headers do not match.
== Archiving ==
Note that what we can accomplish here will be based on the availability of an Archiving Champion.
Mailman 3.0 is most suitable to new installations of Mailman. We do not guarantee that it will work well for migrations and upgrades of Mailman 2.x; we believe that will work, but encourage you to make backups and test your migrations first. It is not yet at full feature parity with Mailman 2.x, but we're working on that for 3.1.
Line 48: Line 17:
 * Reconsider using a 3rd-party archiver
 * Perhaps URLs to messages should be based on message-ids instead of message numbers so that regenerating archives can't break links. '''This must include backward compatible links'''
 * Ditch direct access and vend all archive messages through CGI so that we can do address obfuscation, and message deletion, etc. on the fly (with caching of course, but have to worry about web crawlers).
 * [[http://lists.w3.org/Archives/Public/www-rdf-interest/2003Feb/0047.html|Add RSS feed]]
 * Allow for admins to remove or edit messages through the web.
 * Move archive threads into another list?
 * Put archives in the list/''mylist'' directory.
 * Add a search option
 * Make archives default template look and feel similar to Web UI (whatever it looks like after the [[../Summer of Code|Summer of Code]] project is done)
 * Make archive templatable (at least by changing CSS) so they can match people's existing site look-and-feel
 * MUAs usually make URLs clickable. An new Archive could be used when posts are distributed, in the footer, so that each message has a link to the whole thread in the Archive.
 * Present all messages in a thread at once, and offer plaintext download of the whole thread
 * Put messages into a database and/or move away from mbox as the canonical storage format.
 * Make ISO 8601 compliant? http://wiki.list.org/display/DEV/ISO+8601+date
== Operational/Performance/Administration ==
 * Improve admin statistics gather (# of posts sent, # bounced, # of domains accessed, which lists are quiet and which are busy) and make these available via the web interface.
 * Use a real RDBM on the back end, through a Python-based ORM. ('''Done''')
 * Caps for list member count and outgoing messages per time slice.
 * Better feedback to users who have bounced (e.g. put a link to their last bounced message on their member page).
 * The 'digest option' needs to be improved to delete 'double messages'
 * Add a datetime of when the user subscribed ('''Done''')
 * Provide a better list-data export and import mechanism via XML. ''Possibly'' allow for data export via the web.
 * For Postfix, switch to [[http://www.postfix.org/VIRTUAL_README.html|separate domains, non-UNIX accounts]] virtual domains and maildir delivery by default. Delivery mechanics for other MTAs may or may not change.
 * Partition queue directories into hashed subdirectories so that all queue files do not live in the same directory (which increases contention on the directory inodes and reduces overall performance).
 * Fix the bounce probe problem, and make bounce processing more efficient. Right now, it sucks.
 * Discard messages that have been in the bounces or shunt queues for a long time.
 * Include message headers in discard notifications - currently it isn't always possible to tell who sent a message that's been discarded, which makes it a bit pointless sending a notification. It would be nice to include brief headers in the first message part.
Developer resources:

 * [[http://aosabook.org/en/mailman.html|Architectural overview]]
 * [[https://gitlab.com/mailman |Mailman 3 projects on GitLab]]
 * [[https://gitlab.com/mailman/mailman/issues | bugs affecting the Mailman 3.x series]]
 * [[http://docs.mailman3.org/en/latest/devsetup.html| Development Setup Guide]]
Line 76: Line 25:
 * [[DEV/LMTP process|LMTP process]]
Line 77: Line 27:
 * [[DEV/LMTP process|LMTP process]] == Installation HowTo ==
See http://docs.mailman3.org/en/latest/index.html for installation information. There exists debian packages and Container Images for Mailman 3. The above mentioned link has more details about requirements, installation howto and such.

Mailman 3.0

Mailman 3.0 was released on April 28, 2015. See also the release notes.

Contributors are welcome and encouraged! Discussions will happen on the mailman-developers mailing list. Anyone can check out and use the current development source branches.

Development and status

Mailman 3 is essentially four main projects:

Mailman 3.0 is most suitable to new installations of Mailman. We do not guarantee that it will work well for migrations and upgrades of Mailman 2.x; we believe that will work, but encourage you to make backups and test your migrations first. It is not yet at full feature parity with Mailman 2.x, but we're working on that for 3.1.

Developer resources:


Installation HowTo

See http://docs.mailman3.org/en/latest/index.html for installation information. There exists debian packages and Container Images for Mailman 3. The above mentioned link has more details about requirements, installation howto and such.

MailmanWiki: DEV/Mailman 3.0 (last edited 2018-04-20 06:57:02 by maxking)