digitally signed messages

To defend from email abuse, more and more email servers
check the sender’s identity before delivering the message.

Sending emails without RealSender, your recipients can’t be sure
that the message received was generated by you.

Sending emails using RealSender, all the messages you send
are digitally signed, so that the recipients can trust them.

There are two standards to check the sender’s identity: SPF and DKIM.
RealSender offers both of them:

• SPF declares which are the authorized smtp servers for a certain domain
• DKIM digitally signs each message sent from a certain domain and its related smtp server
  All the information used to check the DKIM signed messages
  are saved and locked within the domain’s DNS settings

smtp servers with dedicated ip
each customer receives a dedicated IP address the IP address is monitored daily over 60+ blacklists

secure smtp autentication
the server accepts only messages sent with SMTP authenticated over secure connection
using TLS or SSL (the communications are encrypted using a dedicated digital certificate)

sender’s address check
the server accepts only the sending of messages from senders that have been configured and authorized

full email authentication
all messages sent through the server are authenticated using the standard protocols: SPF and DKIM

dedicated IP address

The “Internet Protocol address” or “IP address”
is similar to a telephone number on your home phone or mobile device.

It is personally identifiable information that is automatically captured
by another computer when any communications link is made over the Internet.
No other device on the Internet will have the same IP address.
This is necessary for a device to communicate with another.

“Dedicated” IP addresses are important for sending email messages
because their reputation has a strong impact on being accepted or not.

Using “shared” IP addresses for business communications
is like sending each time a different sales representative to the same customer.
Not knowing him, the recipient will treat him with suspicion.
In extreme cases, if the same seller offers different products every day,
it is very likely that he will no longer be accepted the next time he knocks on the door.

Most SMTP services on the internet provide “shared” IP addresses to their customers.
Each time you send an email, a different IP address is assigned.
Something similar happens with cloud hosting providers, who offer services on a “per minute” basis.
In this case, they give one or more “temporarily assigned” IP addresses.

Since its inception in 2009, RealSender has decided to offer only SMTP servers with “dedicated” IPs.
This means that each customer receives an IP address that will not change over time.
Linking it to the corporate domain name via email authentication, will make both of them more authoritative.

If your communications are consistent and expected,
little by little they will be recognized by the recipients, who will award them a higher reputation.
This trust can reach high levels, so that all-transmitted communications
they will be automatically accepted and considered Important or High Priority.

dedicated hostname

A corporate smtp hostname is used in multiple applications settings.
Changing it is an error-prone activity that takes time.

RealSender allows you to define your subdomain, such as:

smtp.youremaildomain.com

We’ll take care of everything, including SSL certificates
that are required for secure smtp authentication.

This setup will give you complete peace of mind,
knowing that the smtp hostname is under your control.

Your IT staff won’t have to remember where it’s configured
since it will no longer be necessary to change it.

security settings

Switch from your current mailserver to RealSender safe environment.

You may use the same authentication credentials
as well as the smtp hostname, when it is under your domain name.

You can send email messages securely, even without authentication.

Topics in this area:

email client settings

To start using RealSender:

1. Request a free trial account
   
   
2. Change the settings of the outgoing mail (SMTP) within your email client:
   Outlook - Outlook 2007 - Outlook 2013 2016 - Mac OS/X Mail - Thunderbird - Zimbra Desktop
   
   Your’s not in the list above? Contact us!
   
   Visit the “Email Server” area if you use a centralized email system.
   Check our “Newsletter software” area if you plan to send mass mailings.
   
   
3. Change your domain’s settings to authenticate the sent messages with SPF
   (this is generally done after the trial period)
   
   

• Why? If you wish to have email from your domain sent through a third party service,
  you must configure your SPF record to permit delivery from the service provider’s IP addresses.
  If you don’t do this, then you risk having email receivers reject all email sent from your domain.
  
  
• Setting up the RealSender SPF record is easy:
  all you have to do is add include:spf.realsender.com to your SPF record, and you’re done.

We automatically sign emails with DKIM, so you don’t need to do anything else.

Questions? Contact us!

email server settings

To start using RealSender:

1. Request a free trial account
   
   
2. Change the settings of the outgoing mail (SMTP) within your email server:
   Microsoft Exchange Server - Microsoft Office 365 - Zimbra Collaboration
   
   Your’s not in the list above? Contact us!
   
   Visit the “Email Client” page if you use individually configured email clients.
   Check our “Newsletter software” area if you plan to send mass mailings.
   
   
3. Change your domain’s settings to authenticate the sent messages with SPF
   (this is generally done after the trial period)
   
   

• Why? If you wish to have email from your domain sent through a third party service,
  you must configure your SPF record to permit delivery from the service provider’s IP addresses.
  If you don’t do this, then you risk having email receivers reject all email sent from your domain.
  
  
• Setting up the RealSender SPF record is easy:
  all you have to do is add include:spf.realsender.com to your SPF record, and you’re done.

We automatically sign emails with DKIM, so you don’t need to do anything else.

Questions? Contact us!

doublebackup app

Email messages are the main channel of modern business communications.
Their accidental loss would great damage the company’s knowledge base.
Furthermore, business correspondence should generally be kept for up to ten years.

 !! if your company is using personal mailboxes
 such as name.surname@companyname.com  
 you must have informed the senders before activating this function

We provide you with a dedicated inbound email domain,
so RealSender’s “doublebackup” app archives transparently
all the emails, that you can access via:

• a special pop3 mailbox
  configured to accept large amounts of emails in a short time
  
  
• a secure web area
  available online through a customized version of our inxbox web interface

An automatic process archives the messages divided by recipient, month and year.

When associated with RealSender Email Gateway,
all the sent emails are duplicated and archived automatically.

spamstop app

Email is the main channel for cyber attacks.

Sender address spoofing can be detected by email authentication information.

RealSender’s “spamstop” app shows the results of authenticity checks
directly in the subject of received messages.

This also allows you to continuously check
the correct email settings of your company, customers and partners.

It is an efficient anti-spam solution when combined with a filter
that splits messages according to senders that are NOT in your address book.

Topics in this area:

newsletter software settings

To start using RealSender:

1. Request a free trial account
   
   
2. Change the settings of the outgoing mail (SMTP) within your newsletter software:
   GroupMail - Inxmail Professional - Joomla AcyMailing - MaxBulk Mailer - phplist
   SendBlaster - Sendy - WordPress MailPoet 3 - WordPress MailPoet 2 - WordPress Mailster
   
   Your’s not in the list above? Contact us!
   Alternatively, evaluate the “copymail app” option!
   
   Visit the “Email Client” page if you use individually configured email clients.
   Visit the “Email Server” area if you use a centralized email system.
   
   
3. Change your domain’s settings to authenticate the sent messages with SPF
   (this is generally done after the trial period)
   
   

• Why? If you wish to have email from your domain sent through a third party service,
  you must configure your SPF record to permit delivery from the service provider’s IP addresses.
  If you don’t do this, then you risk having email receivers reject all email sent from your domain.
  
  
• Setting up the RealSender SPF record is easy:
  all you have to do is add include:spf.realsender.com to your SPF record, and you’re done.

We automatically sign emails with DKIM, so you don’t need to do anything else.

Questions? Contact us!

make it easy to unsubscribe

Always give recipients an easy way to unsubscribe from your messages. 
Letting people opt out of your messages can improve open rates, 
click-through rates, and sending efficiency. 

Important: If you send more than 5,000 messages per day, 
your marketing and subscribed messages must support one-click unsubscribe.

-- Gmail, Email sender guidelines, 2024

Learn more about List-Unsubscribe: headers in RFC 2369 and RFC 8058.

After considering that most of our customers were NOT using List-Unsubscribe: headers in their sent messages,
we decided to add them automatically to each message, only if those headers are not already present.

Cancellation requests MUST BE HANDLED within two days.
You must NOT respond with a request to unsubscribe in any other way.

An email message will be automatically generated by Gmail and other providers.
It will be delivered to the email address you communicate to us (even more than one).

Alternatively, at the web address: rsXXX-realsender.com/unsubs
you can access all list-unsubscribe requests received in the last seven days,
in JSON format, as per the example below:

  {
    "mailbox": "rsXXX",
    "id": "20241107T001800-0000",
    "from": "<john.doe@gmail.com>",
    "to": [
      "<abuse@rsXXX-realsender.com>"
    ],
    "subject": "RealSender :: rsXXX Nov-7 4A6NDqsl008203 :: please UNSUBSCRIBE me ::",
    "date": "2024-11-07T00:18:00.938050657+01:00",
    "posix-millis": 1730935080938,
    "size": 4350,
    "seen": false
  },

bouncehandler app

Repeated sending to wrong / inactive recipients is considered “spammer behavior”.
In recent years, more and more smtp servers have been blacklisted for this reason.

The most noticeable error occurs when the Mail-From/Return-Path address mailbox,
the one receiving the bounced messages, is full or non-existent.
By sending thousands of messages, if 20% come back, it’s easy to fill even a large inbox in minutes.

Receiving all bounced messages without reading them could be considered a minor flaw.
You keep sending emails to addresses that bounce back, with error details that no one cares about.

In both cases, the result is that the smtp server is blacklisted. In this way,
not only will messages not be delivered to invalid recipients, but valid recipients will also receive them as SPAM.

To solve the first problem, we have been offering “newsletter mailboxes” for a long time.
Analyzing bounced messages is more difficult and requires a tool that works very well.

We chose “Sisimai: Mail Analyzing Interface”, formerly known as bounceHammer 4: an error mail analyzer.
An open source software, that parses RFC5322 bounce mails and generates structured data as JSON.

To get an idea of all the possible error codes that Sisimai parses, take a look at “The SMTP Field Manual”,
a collection of raw SMTP error code responses from major email service providers.

The automatic blocklist

Implementing the bounce handler within RealSender is simple.

1. activate the “newsletter mailbox”
2. configure your sending application to use the new Return-Path address
3. ask to verify the setup and activate the “bounce handler”

The “bouncehandler” app starts checking the bounced messages.
Two blocklists are activated:

1. the hard bounces blocklist
   contains all the email addresses that generated a permanent error,
   such as user unknown or host unreachable
   
   the weekly hard bounces log is available at the web address:
   https://…hardbounces.email.weekly

2. the soft bounces blocklist
   contains all the email addresses that generated three or more transient errors,
   such as mailbox full, at least one week away from each other
   
   the weekly soft bounces log is available at the web address:
   https://…softbounces.email.weekly

Sending messages to a blocklisted recipient will generate an error like this:

Manage your blocks independently

We provide you with the following files,
as web addresses, protected by password or IP address:

https://…bounces.json
the details of the bounces received in the last seven days, in JSON format, such as:

  {
    "feedbacktype": "",
    "addresser": "info@circuitocinemascuole.com",
    "diagnostictype": "SMTP",
    "timezoneoffset": "+0200",
    "lhost": "linp.arubabusiness.it",
    "destination": "gmail.com",
    "timestamp": 1635536166,
    "senderdomain": "circuitocinemascuole.com",
    "deliverystatus": "5.1.1",
    "token": "daad8f8fc89cef70e1406a9d2b38be6c35326e03",
    "recipient": "...@gmail.com",
    "subject": "Prenotazioni aperte_Giornata Internazionale dei Diritti dell'Infanzia e dell'Adolescenza_Film FIGLI DEL SOLE",
    "origin": "/home/rs109-bounce/Maildir/new/1635528969.21113_0.rsbox.realsender.com",
    "rhost": "gmail-smtp-in.l.google.com",
    "reason": "userunknown",
    "diagnosticcode": "550-5.1.1 The email account that you tried to reach does not exist. Please try double-checking the recipient's email address for typos or unnecessary spaces. Learn more at https://support.google.com/mail/?p=NoSuchUser z3si7494964ybg.507 - gsmtp 503 5.5.1 RCPT first. z3si7494964ybg.507 - gsmtp",
    "messageid": "McuPi4DjtlyhvlSMVNB4wTXsUKQeIy6XwlKoAZuJ4@www.circuitocinemascuole.com",
    "listid": "",
    "action": "failed",
    "softbounce": 0,
    "replycode": "550",
    "catch": null,
    "alias": "",
    "smtpagent": "Sendmail",
    "smtpcommand": "DATA"
  },

https://…hardbounces.json
the details of the hard bounces ¹ received in the last seven days, in JSON format

https://…hardbounces.email
the list of email addresses that generated a hard bounce ¹ in the last seven days

¹ = selection criteria: softbounce == 0

https://…softbounces.json
the details of the soft bounces ² received in the last seven days, in JSON format

https://…softbounces.email
the list of email addresses that generated a soft bounce ² in the last seven days

² = selection criteria: softbounce == 1

These are the same files used by the automatic blocklist:

https://…hardbouncesfull.email
the list of all email addresses that generated two or more hard bounces
at least one week away from each other

https://…softbouncesfull.email
the list of all email addresses that generated three or more soft bounces
at least one week away from each other

copymail app

RealSender “copymail” app lets you send mass mailings,
up to a few thousands of recipients, directly from your email client.

With three easy steps:

1. upload your recipients’ list
2. send the message you want to distribute to the “list-post” email address we will provide you
3. approve the message to start the delivery

Each recipient will receive the message as if it were sent to himself only.

The list administrator will be notified by email
for every address that generates an “hard bounce”
(permanent failure, such as “user unknown”).

Essential features:

• Membership Management
• Mass Subscriptions
• Pending Approvals

Membership Management

back to top

Mass Subscriptions

back to top

Pending Approvals

back to top

smtp without authentication

Sometimes old softwares or very simple applications
do not allow to issue a secure authentication as RealSender requires.

The solution is to provide an open a port to go through the smtp server,
checking only the connection’s ip address and the sender’s email address.

In this way you’ll be able to send your email messages without authentication,
but you will always be allowed to authenticate whenever possible.

RealSender partners and large organizations
can independently update the list of authorized IPs.

sending via api

Topics in this area:

sending via http request

Topics in this area:

formmail app

Receiving clear and structured information via the internet can be complicated.
It needs a user interface to fill in and a server application that sends the data.

RealSender’s “formmail” app lets you create simple and responsive forms,
therefore usable also on tablets and smartphones with small screens,
that will send the data directly to your email address.

Few “Drag & Drop” components
will help you structure your questions:

The source is downloadable
in a ready-to-use “form.html” file:

You can try it yourself at formmail.realsender.com/forms

• add a “Text Input” field and a “Button”, that will let you submit the form
• click the “Download” button within the “Rendered” tab to save the file locally
• open form.html and enter some text and press the button to submit the contents
  (ATTN: because it’s not published online, the “Thank You” page will be coarse)

The message is received in the RealSender’s “temporary email” service.

Request a free trial if you want to publish the html file online.
You will thus get an elegant confirmation popup:

The entered data will be delivered directly to your email box.

smsgateway app

Broaden your perspectives. Connect your emails to the mobile world.
Maximize your business communication possibilities, without changing your habits.

• Send SMS from your email
• Reply to SMS from your email
• Convert email attachments into SMS links

Send SMS from your email

Push notifications are the most effective way to reach your customers quickly.
With super high open rates (up to 95%) and top response rates (up to 45%).

• • source: Gartner study on Text Messages, year 2019

Recipient: mobilenumber@sms.yourdomain.com
Subject:   the SMS message content

(additional email content and attachments are ignored)

Setup requires a Teltonika industrial router and a SIM from your mobile operator.
Our staff or one of our partners can provide you with the details and help you with the settings.

Control over the sending and delivery of text messages must be carried out via the operator used.
Our system checks every ten minutes that the router is responding (check power and internet connection).

To avoid abuses, which can happen by forging the sender’s identity (spoofing),
messages must be sent via RealSender, using pre-authorized senders,
with the SPF and DKIM “strict” alignment. Learn more on email authentication - advanced.

» back to top

Reply to SMS from your email

RealSender’s “smsgateway” app lets you send SMS text messages directly from your EMAIL.

The text message received will be delivered directly to your preferred mailbox,
with an email message like this:

Subject: Text-Message (+41790000000)

Below is the received text message.  It was submitted by
 (+41790000000) on Monday, July 29, 2023 at 10:57:00 CEST
---------------------------------------------------------------------------

Test Message

---------------------------------------------------------------------------

So you can reply from your favorite email application.
The recipient address is already filled with the original sender number:

Recipient: mobilenumber@sms.yourdomain.com
Subject:   the content of the reply SMS message

(additional email content and attachments are ignored)

The conversation between email application and mobile device can thus continue.

» back to top

Convert email attachments into SMS links

Just write “[A]” in the text and add an attachment to the email.
The “smsgateway” app will automatically convert it into a link.

The domain in the link can be any dedicated domain or subdomain you wish to use.
The file will be DELETED after twelve months.

» back to top

about us

During the years 2006-2009, after having distributed
for more than a decade a German email marketing platform,
we knew the importance of the smtp server reputation.

There was only one way to guarantee it:
a dedicated smtp server, with dedicated IP address, for each customer.

Our task is: "to deliver your emails".
We work hard for it every day.

Providing a reliable, constantly monitored environment.

Giving you full control and the awareness of the outgoing emails,
so that the recipients will receive and trust your messages.

contacts

To get in touch with us for commercial or technical issues:

1. Web form: contact us form

2. Telephone: +41 61 5000365

3. Messages: +41 79 6276163

Our office is open Monday to Friday, between 9:00 a.m. and 7:00 p.m. (Central European Time).

How to reach us:

• Park+Rail at the railway station
  6855 Stabio - Switzerland
  
  
• Milano Malpensa (MXP)
  international airport
  
  

VAT/EU VAT ID no. IT02457460125

plans & pricing

	RealSender single dedicated smtp server it can send up to 10,000 emails per week (generally used for 1-to-1 / transactional emails)
	HighSender one email gateway to multiple dedicated smtp servers relays over 2 to 100 servers, automatically balanced it can send up to 1,000,000 emails per week (generally used for newsletters / mass mailings)
	services identified as “apps” have an additional cost please contact us for more information

terms of service

RealSender has a zero tolerance for SPAM (unsolicited email advertising). Customers sending out unsolicited commercial email or prohibited advertising or other harassing or illegal materials through email, will be subject to immediate account termination without any refund. Repeated mailing to wrong recipients and the failure to comply with the weekly limit are considered a “spammer behaviour”.

The “email from addresses” for each RealSender account must be under one or more domain names registered by the same company. Each server can send up to 10,000 emails per week. The number of recipients for each piece of email is limited to 100. RealSender service is provided for business use only: both a full mailing address and tax id number are required.

RealSender simply conveys the emails and does not check the content thereof under legal, factual or other aspects. RealSender is furthermore not responsible for the content of the emails it conveys.

Customer agrees to indemnify RealSender against any liability for any and all use of Customer’s account. Furthermore, Customer agrees to indemnify and hold RealSender harmless from any claims and expenses, including reasonable attorney’s fees, related to Customer’s violation of the Service Agreement or Customer’s direct or indirect damage to another party.

Customer expressly agrees that use of RealSender’s service is at customer’s sole risk. Neither RealSender nor any of its information providers, licensers, employees, or agents warrant that the service will be uninterrupted or error free; nor does RealSender or any of its information providers, licensers, employees, or agents make any warranty as to the results to be obtained from use of the service. the service is distributed on an “as is” basis without warranties of any kind, either express or implied, including but not limited to warranties of title or implied warranties of merchantability or fitness for a particular purpose or otherwise, other than those warranties which are implied by and incapable of exclusion, restriction, or modification under the laws applicable to this service agreement. Neither RealSender nor anyone else involved in creating, producing or delivering the service shall be liable for any direct, indirect, incidental, special or consequential damages arising out of use of the service or inability to use the service or out of any breach of any warranty. Customer expressly acknowledges that the provision of this paragraph shall also apply to all third party content and any other content available through the service.

Upon notice provided in written, faxed or emailed form to the Customer, RealSender may modify this Service Agreement or prices, and may discontinue or revise any or all aspects of the Service in its sole discretion without prior notice.

RealSender is a registered trademark in US and EU since 2010.

limits of our offer

• For each customer, a dedicated smtp server is prepared, tuned and kept active 24/7.
  This has a minimum cost that you won’t find in shared smtp environments,
  which on the other hand offer very few guarantees and high risks for those who use them.

• We do not control the content of the messages sent, these can cause the delivery to the Spam / Junk folder.

• Some freemail providers, per default deliver messages from unknown senders to the junk mail folder.
  
  Their antispam system learns from what their users do with the messages they receive.
  If the individual recipient flags once the received mail as NON spam, it will learn that they are valid messages
  and will begin delivering them to the “Inbox” folder instead of “Junk”.
  
  Alternatively, the sender must be in the address book of the recipient or have previously exchanged emails.
  
  Our technical staff will help you to identify these cases and to implement an effective delivery strategy.

privacy policy

RealSender simply conveys the emails on behalf of its customers and does not monitor or archive the content.

We keep the logs of the last 7 days and the statistics related to the traffic generated, which are available to the customers as described here:
Logs & delivery
Statistics

The use of the service is subject to acceptance by our customers of the Terms of service.

In case of abuse we act quickly, thanks to the automatic monitoring system on blacklistings.

All of our servers’ homepages advertise the email address to report unsolicited advertising emails transmitted by our customers: [abuse@realsender.com] (mailto: abuse@realsender.com)

The Data Protection Officer can be reached filling this form.

glossary

• Closed loop marketing
  the process by which customer data can feed your marketing campaigns and drive up sales performance.

• DomainKeys Identified Mail (DKIM)
  DKIM is an email authentication protocol that enables the sender to use public-key cryptography to sign outgoing emails in a manner that can be verified by the receiver. The DKIM specification is based on the prior protocols Domain Keys and Identified Internet Mail. DKIM is defined in IETF RFC 4871. The DKIM standard is already being adopted by Gmail and other large corporations to completely eliminate phishing and spoofing from internet mail.

• email authentication technology that verifies whether an email message originates from the domain name it claims to have been sent from [2]. Ensuring a valid identity on an email has become a vital first step in stopping spam, forgery, fraud, and even more serious crimes. [3]

• Internet Engineering Task Force (IETF)
  the Internet Engineering Task Force is a large open international community of network designers, operators, vendors, and researchers concerned with the evolution of the Internet architecture and the smooth operation of the Internet. It is open to any interested individual. The goal of the IETF is to make the Internet work better.

• Message Transfer Agent (MTA)
  any system running SMTP routing software that can take a message, process it, look up destination information in DNS (or other routing table), and deliver to the intended receiving system. MTAs are typically server applications such as Sendmail, Microsoft Exchange, Postfix, Lotus Domino, qmail, PowerMTA, etc.

• secure smtp
  extension to the SMTP service that allows an SMTP server and client to use TLS (Transport Layer Security) to provide private, authenticated communication over the Internet. [1]

• Sender Policy Framework (SPF)
  SPF is a path-based email authentication protocol that allows email receivers to determine if the sender is authorized to use the domains in the message’s header by evaluating the IP address of the sender’s outbound MTA based on information published by the sender in DNS TXT records. SPF is defined in IETF RFC 4408.

• Simple Mail Transfer Protocol (SMTP)
  is an Internet standard for electronic mail (e-mail) transmission across Internet Protocol (IP) networks. SMTP was first defined by Jonathan Postel in IETF RFC 821 (1982), and last updated by IETF RFC 5321 (2008) which includes the extended SMTP (ESMTP) additions, and is the protocol in widespread use today. SMTP is specified for outgoing mail transport and uses port 25.

• Transport Layer Security (TLS)
  the TLS protocol provides communications security over the Internet. The protocol allows client/server applications to communicate in a way that is designed to prevent eavesdropping, tampering, or message forgery. TLS is an IETF standards track protocol, last updated in RFC 5246.

References:

[1] RFC 3207 - SMTP Service Extension for Secure SMTP over Transport Layer Security
[2] 2008 OTA State of the State of Email Authentication Report
[3] Email Authentication by David MacQuigg

email authentication basics

Topics in this area:

email authentication advanced

Topics in this area:

email delivery analysis

Topics in this area:

system status page

To verify the correct functioning of the service,
we have activated an automatic control environment.

An external application connects to each SMTP server every ten minutes
and sends a real message. The successful sending of the email allows us to guarantee
the availability and correct functioning of the system.

The result is published on the “status page” of your RealSender server,
freely accessible at the web address: rsXXX-realsender.com/status

The data is displayed in real-time, such as the example data shown below.
The information shown is for the last twenty-four hours.

2024-09-11 06:25:26 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 06:16:18 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 06:05:56 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 05:55:41 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 05:45:57 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 05:35:58 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 05:25:27 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 05:16:30 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 05:05:57 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

2024-09-11 04:55:36 UTC		
rsXXX- every ten minutes UPTIME CHECK (an email has been successfully sent) - OK

enigma secure email

Email is not private or secure. It wasn’t designed with privacy or security in mind.
Anyone who handles your email in transit can read it,
including your ISP, a hacker, or the NSA (U.S. National Security Agency).

End-to-end (e2ee) encryption for email can be used to ensure
that only the sender and the recipient of a message can read the contents.
PGP is the best solution for secure communications with a partner that is
already using it. Asking your counterpart to start using PGP could be hard.

Enigma is an app based on the SnapPass open source project.
It allows you to share secrets in a secure, ephemeral way.
Input a single or multi-line secret, its expiration time and click Generate URL.
Share the one-time use URL with your intended recipient.

Try it out:
enigma.realsender.com

inxbox temporary email

inxbox is a ready-to-use temporary mailbox
that receives any message  
and keeps it in memory for an hour

!! all received messages are visible to anyone !!

Try it yourself now! (1)

• send a message to: [yourname]@inxbox.realsender.com
• open https://inxbox.realsender.com/monitor and check check for reception
  (use Google Chrome browser > New Incognito Window or Microsoft Edge browser)

Try it yourself now! (2) with your own domain

• change/add the MX record of your domain to:
  MX “10 inxbox1.realsender.com”
• Send a message to: yourname@yourdomain
• open https://inxbox1.realsender.com/monitor and check check for reception
  (use Google Chrome browser > New Incognito Window or Microsoft Edge browser)

pay attention: the associated domain name is different from the previous point

Download the messages via pop3

• configure your email client with the following settings
• Server Type: POP Mail Server
• Server Name (1): inxbox.realsender.com - Port: 110 (Default)
• Server Name (2): inxbox1.realsender.com - Port: 110 (Default)
• User Name: only “yourname” within the recipient address
• Password: any value is accepted

inxsend fake smtp/api service

inxsend is a Fake SMTP/API Service

for testing emails in applications easily
by sending all the messages to a single mail server

SMTP server settings

Configure the smtp server with the following parameters:

Server Name: inxsend.realsender.com  
Port:        25 |or| 2525 |or| 587 (+TLS) |or| 465 (+SSL)  
User Name:   CDED54  
Password:    478DED

API server settings

Use API access as described in the “sending via api” instructions, with the following parameters:

Server address: (https://) inxsend-api.realsender.com/mail/send
apiuser:        CDED54  
apipass:        478DED

Send a test message

Send a message to:
[yourname]@inxbox.realsender.com

!! all received messages are visible to anyone !!
(other recipients will be rejected)

Let us know if you’re facing any issue.

Check reception

Open https://inxbox.realsender.com/monitor and check for reception
(use Google Chrome browser > New Incognito Window or Microsoft Edge browser)

Further information on this mailbox is available at: inxbox temporary email.

tester for spf and dkim

RealSender offers a free online check tool
to validate your SPF + DKIM settings sending an email message:

1. send an email to spf@tester.realsender.com
2. check online the SPF validation results at tester.realsender.com/spf
   (it will take a minute to appear)

During verification, a prefix is added to the subject
if the message is not authenticated correctly.

Details on how it works
are located in the “email authentication basics” area of the website:
email authentication basics :: <spf> check online

how to EXTRACT EMAIL addresses

Sometimes you have exported data from your website or business software
containing order information or customer details.
You may have only needed the email address and order date.

One way is to import all the data into Excel, delete the unwanted columns
and export the remaining ones.

This may not work well if the email field also contains the email address description,
for example: “Dave Martin <davemartin@bogusemail.com>”.

It can be cumbersome if you have to repeat the task multiple times
or if you have to explain all the steps to someone else.

Extract the desired data using “regex”

A regular expression (shortened as “regex” or “regexp”),
is a sequence of characters that specifies a matching pattern in text.

A very simple case is to locate a word spelled two different ways in a text editor,
the regular expression seriali[sz]e matches both “serialise” and “serialize”.

A more complex situation is the syntax for identifying in the text

• an email addresses:
  [a-zA-Z0-9._-]+@[a-zA-Z0-9._-]+\.[a-zA-Z0-9_-]+
  source: stackoverflow - regex extract email from strings

• a date:
  \d{4}-\d{2}-\d{1,2}
  source: stackoverflow - regex for extracting date from string

Regular Expressions (Regex) Tutorial

Recommended YouTube video
“38 mins well spent, totally worth it” :

How to Match Any Pattern of Text
(from minute 25 the syntax for extracting email addresses is explained)

Cheat sheet for using regular expressions

RegExr online tool

Regular expressions are generally accepted
within advanced text editors like Notepad++ or Atom.

Free online tools are also available, one of them is:
https://regexr.com - an online service to learn, build & test Regular Expressions.

Web interface explanation:
“Expression” is the field that contains the regex syntax.
“Text” is the content you want to analyze.
“Tools > List” will show the results of the extraction.

Example 1: to extract only the email address

Expression:
[a-zA-Z0-9._-]+@[a-zA-Z0-9._-]+\.[a-zA-Z0-9_-]+

Text:

Dave Martin
615-555-7164
173 Main St., Springfield RI 55924
davemartin@bogusemail.com

Charles Harris
800-555-5669
969 High St., Atlantis VA 34075
charlesharris@bogusemail.com

Eric Williams
560-555-5153
806 1st St., Faketown AK 86847
laurawilliams@bogusemail.com

Tools > List:
$&\n

Result:

davemartin@bogusemail.com
charlesharris@bogusemail.com
laurawilliams@bogusemail.com

Example 2: to extract the email address and the date

Expression:
","(.*?)([a-zA-Z0-9._-]+@[a-zA-Z0-9._-]+\.[a-zA-Z0-9_-]+)(.*?)",".*",(\d{2}\.\d{2}\.\d{4})

Text:

"lorem ipsum dolor sit amet","Robert Farrell <rmfarrell@bogusemail.com>","",02.01.2024, ,5379,
"consectetur adipiscing elit","""Mesa, Rene <rmesa@bogusemail.com>""","",04.01.2024, ,20826,
"sed do eiusmod tempor incididunt","Antonio Bugan <antonio@bogusemail.com>","",04.01.2024, ,2856,
"ut labore et dolore magna aliqua","Crawley Down Tennis Club <hello@bogusemail.com>","",05.01.2024, ,4453,

Tools > List:
$2,$4\n

Result:

rmfarrell@bogusemail.com,02.01.2024
rmesa@bogusemail.com,04.01.2024
antonio@bogusemail.com,04.01.2024
hello@bogusemail.com,05.01.2024

Cheat sheet for using regular expressions

.       - Any Character Except New Line
\d      - Digit (0-9)
\D      - Not a Digit (0-9)
\w      - Word Character (a-z, A-Z, 0-9, _)
\W      - Not a Word Character
\s      - Whitespace (space, tab, newline)
\S      - Not Whitespace (space, tab, newline)

\b      - Word Boundary
\B      - Not a Word Boundary
^       - Beginning of a String
$       - End of a String

[]      - Matches Characters in brackets
[^ ]    - Matches Characters NOT in brackets
|       - Either Or
( )     - Group

Quantifiers:
*       - 0 or More
+       - 1 or More
?       - 0 or One
{3}     - Exact Number
{3,4}   - Range of Numbers (Minimum, Maximum)

source: github code snippets

back to top

how to protect ''NO-MAIL'' domains

Most companies and public bodies register multiple domain names.
Businesses often purchase more than one domain to defend against user error and protect their brands.
Other times to promote events or projects that deserve special visibility.

The numbers can vary from a few dozen domains up to several hundred for a single activity.
They range from about two hundred in a Municipality of a large city, to the thousands of Ferrari and Goldman Sachs.

Up to staggering numbers when you count the total number of registered domains,
which at the end of 2022 reached 350 million domain names, as claimed by Verisign.

Many of these domains are used as a “showcase”. There are no email addresses listed on the website.
Contact requests are generally redirected to forms to be filled in or to social media channels.

The management of email sendings, with the necessary authentications (SPF, DKIM, DMARC, …) is becoming more and more complex.
For this reason, only one domain is usually the one actually used for official external communications via email.

However, the idea of protecting one’s online presence can prove to be a double-edged sword.
Misconfigured “showcase domains” can easily be exploited by malicious actors.

They often abuse the well-known name of the sender, to gain the trust of recipients and demand actions
that expose confidential information or the opening links and attachments.

Recipients are at risk of compromising the security of their systems,
allowing access from the outside to gangs of digital criminals.

The complex authentication systems mentioned above also have their positive sides.
The DMARC protocol was designed to act on fake emails,
to prevent unauthorized individuals or organizations from shipping with our senders.

A quick setup allows you to declare that a given domain is NOT in use,
warning recipients to reject any email from that domain.
It is sufficient to insert a record (single row) in the domain dns with this indication:

_dmarc.yourdomain.com. TXT "v=DMARC1; p=reject"

Whether this rule applies depends on the system receiving the messages.
The good news is that the DMARC protocol has been an approved IETF standard since March 2015.
Most online email services implement it to protect their users.

Messages from “NO-MAIL” domains will be BOUNCED automatically.

In this way, in addition to protecting your company from abuse, you will prevent “old” domains,
that are no longer authorized to send nor authenticated, from being used by mistake.

why do businesses use SMS

The issue: unread emails, unanswered calls

An email inbox is full of competition for the consumer’s attention,
making it that much harder for businesses to get noticed by their customers and prospects.

Getting someone to read an important email (or even getting them on a phone call)
is becoming more and more difficult.

48% of consumers have more than 50 unread messages in their inbox.
Most consumers refrain from weeding out unread messages, so emails keep piling up.
– source: ZipWhip Why Your Customers Don’t Read Your Emails Anymore (pdf 15 MB)

Some updates are urgent and may be critical. Delivering them by email entails a risk
of the message not being read or landing in the spam folder.

When asked “how many email accounts do you have?” 77% answered “two or more”.
Usually only one is configured on the smartphone.

Calling customers and NOT getting an answer
or having the call go to voicemail,
is becoming increasingly common.

97% of consumers admit to ignoring calls from businesses and unknown numbers.
– source: ZipWhip Why Your Customers Don’t Answer the Phone Anymore (pdf 15 MB)

The solution: text me

covid-19 increased the use of electronic devices,
64% of interviewed people declared: “I spend more time on my phone”.

58% of consumers say that texting is the most effective way for businesses to reach them quickly.
– source: ZipWhip State of texting 2021 (pdf 21 MB)

Even in e-commerce, where email is usually required for registration,
some large companies, including Amazon, offer the possibility to register via the mobile number.

The explanation: five good reasons for texting

1. It is immediate
   Text messages are almost always read, usually seconds after they’re received.
   Open rates exceed the 95% threshold (of this 95%, 90% occur within three minutes of delivery).
   SMS messages are short and concise, communications are essential and immediate.

2. It is simple
   They don’t need an internet connection to get to their recipient.
   It allows your brand to reach demographics that are not well-versed in technology.
   The use is similar to video content (fast, instantaneous, that can be said in 160 characters).

3. It is ubiquitous
   SMS is compatible with every mobile phone on the planet, without installing new apps.
   The smartphone (or old generation mobile phone) is always at the owner’s side like the wallet and the house keys.
   Gives the possibility to interact with a customer wherever he is, through a reliable channel.

4. It is cheap
   SMS messages have a low cost of sending.
   The average length of messages sent does not exceed 155 characters (the limit is 160 characters for a single message).
   Using texts in combination with phone calls or emails can save time when communicating with customers.

5. It is interactive
   Communication takes place through an “unloaded” channel, it is not “pushed”, it is not “stressed”.
   SMS is associated with higher importance, it is more likely to be opened and read. They are also more likely to be answered.
   The language of text messaging is simple and encourages interaction. Response rates are up to 45%.

how to handle BOUNCED EMAILS

Bounced emails or simply “bounces” are the emails sent automatically
by an MTA (Mail Transfer Agent) to the sender,
to inform that the message was NOT received correctly by the recipient

The subject is usually “Returned mail: see transcript for details”.
The explanatory bounce information, a code with a description, can be found in the content.

The “status-code” should clearly identify the type of error that caused the return
but often the codes and descriptions used by each email service provider
must be analyzed and interpreted to classify the bounce correctly.

• What are the risks with bounced emails?
• you cannot ignore them
• you should understand their meaning
• you should know how bounce handling works (and how to tweak it)
• Check the number of bounces
• New trends for bounce handling
• Bounced messages status codes

What are the risks with bounced emails?

Mailing to wrong/inactive recipients is considered a “spammer behaviour”.

• you cannot ignore them

If you want to reach the rest of your list, it’s best to stop sending to the “bad” part of it.
Sometimes this is called “list hygiene”.

• you should understand their meaning

There are three types of Delivery Status Notification (DSN): Success - The email has been delivered (notification is sent only if requested by the sender)
Hard Bounce - A permanent error has occurred
Soft Bounce - A temporary error has occurred

hard bounce (status-code 5.XXX.XXX): the email address generated a permanent error
such as “550 5.1.1 … User unknown” or “5.1.2 … Host unknown”
A permanent error indicates that you should never send to that recipient again.
A single bounced message should trigger email address blocking.

soft bounce (status-code 4.XXX.XXX): the email address generated a temporary error
such as “452 4.2.2 … Mailbox full”
A transient error indicates that you can retry delivery in the future.
At least three bounced messages, within a few days of each other, should trigger email address blocking.

• you should know how bounce handling works (and how to tweak it)

• all returned messages are downloaded by an application
  they’re made available for human review, either through the app interface or through a JSON file
• the Classification follows some rules, which can be edited
• the Options define when soft bounces will be “upgraded” to to hard bounces level

» back to top

Check the number of bounces

Sometimes a configuration error on both the sender’s side and the recipient’s side
can cause a soft bounce or even a hard bounce.

A good habit is to check the number of bounced messages in the last week
to see if the values are the same as before or if there are any anomalies.
If there is something wrong, you will notice immediately. Reading the details of the bounces will help you find the cause.

Some systems allow you to define the number of days (eg 180)
after which a subscriber’s bounce information is discarded.
In this way the smtp server will try to contact that recipient again.

Blocks activated by mistake will be cleared automatically
but the reputation of the smtp server can suffer.

» back to top

New trends for bounce handling

In one sentence: prevention is better than cure.

To avoid damage to the reputation of their SMTP servers,
more and more ESPs (Email Service Providers) use an “email suppression list”
that acts before the messages reach the recipient’s mailbox.

When any customer sends an email that results in a hard bounce,
the email address that produced the bounce is added to the suppression list.

The suppression list applies to all the customers. In other words,
if a different customer attempts to send an email to an address that’s on the suppression list,
the SMTP server won’t send it out, because the email address is suppressed.

Using smtp servers with dedicated IP can avoid some issues related to reputation sharing.
For example, the “email suppression list” can only be limited to your IP address,
so that if another customer causes a blacklisting of the smtp server and the related bounces,
your mailings will not be affected.

» back to top

Bounced messages status codes

Status codes used to identify hard bounces and soft bounces have the following syntax:
status-code = class “.” subject “.” detail

Status codes consist of three numeric fields separated by “.”

• the first sub-code (class) indicates whether the distribution attempt was successful
• the second sub-code (subject) indicates the probable source of any delivery anomaly
• the third sub-code (detail) indicates a specific error condition

The sub-code (class) provides a general classification of the status.
The values ​​listed for each class are defined as follows in the RFC 3463 and the RFC 6522:

2.XXX.XXX Success (NOT sent unless requested by the sender)
Success specifies that the DSN is reporting a positive delivery action. 
Detail sub-codes may provide notification of transformations required for delivery.

4.XXX.XXX Persistent Transient Failure
A persistent transient failure is one in which the message as sent is valid, 
but persistence of some temporary condition has caused abandonment or delay of attempts to send the message. 
If this code accompanies a delivery failure report, sending in the future may be successful.

5.XXX.XXX Permanent Failure
A permanent failure is one which is not likely to be resolved by resending the message in the current form. 
Some change to the message or the destination must be made for successful delivery.

Some code and description examples:

2.0.0: Sent (Message accepted for delivery)

4.2.2: Over quota
4.4.5: Insufficient disk space

5.0.0: Invalid domain name
5.1.1: User unknown
5.7.1: Message content rejected

» back to top

how to check if my SMTP is safe

With the increasing number of ransomware attacks in the 2020s
email, our main communication channel on the Internet, is it safe?

The SMTP servers are a particularly sensitive infrastructure.
They can spread email messages on our behalf,
that our counterparts accept as coming from trusted senders
because they are correctly authenticated by the sending server.

SMTP servers are a particularly sensitive infrastructure.
They spread email messages on our behalf,
that our counterparts accept as coming from trusted senders
because they are properly authenticated by the sender’s SMTP server.

What happens if someone else uses your SMTP server?
How to check if my SMTP server is safe in 2021?

The use of sensitive infrastructures on the Internet
requires a high level of protection to prevent abuse.

If you try to send messages via smtp.gmail.com
you’ll be blocked and receive this “Critical security alert”:

Less secure app blocked  
Google blocked the app that you were trying to use 
because it doesn't meet our security standards. [...]

The only alternative is to use OAuth2, a protocol that doesn’t share password data
but instead uses authorization tokens to prove identity.

The most used mailservers on the Internet (August 2021 data) are:
Exim (58%), Postfix (35%), Sendmail (4%)

To continue using your own mailserver
reducing the risk of being hacked, the minimum requirements to check are:

1. accept only secure authentication
   username and password must be transmitted via secure connections,
   typically port 587+TLS or port 25+TLS or port 465+SSL
   plain text sensitive data communications are disabled

2. there must be a check on the “Mail-From” address (the sender),
   only those you have authorized will be able to pass

3. configure Fail2ban to block all external attacks
   to prevent attempts to force your protections.
   In particular Fail2ban should block all repeated attempts:

• to log in with the wrong username or password
• to send emails with an unauthorized sender
• to interrupt the smtp connection during the authentication process
  (multiple broken connections make the smtp service unavailable for legitimate users)

The block usually occurs between three and ten attempts
and bans the source IP for three to twenty-four hours.

It is quite easy to test these points and decide whether or not
your smtp infrastructure requires a security upgrade.

Fail2ban protects your server against BruteForce/DDOS attacks.
It works as if when a stranger knocks on the door,
after a certain number of strokes, the door disappears.

A testimony from Hacker News:

I manage my own mailserver since several years and I think many others here 
use solutions like Mail-in-a-box, mailcow, Mailu, etc

Until Corona I never had big problems with my mailserver but in the last weeks 
I got very big incoming Traffic - that was too much for my server and i had to manually reboot it every time ...

[...] Edit: I changed my fail2ban settings and found out I was primarily targeted 
by brute force attacks which I should be able to protect against with tools like fail2ban

Fail2ban is a log-parsing application that monitors system logs
looking for the symptoms of an automated attack.

When an abuse attempt is located, using the defined parameters,
Fail2ban adds a new rule to the firewall (iptables or firewalld)
to block the IP address of the attacker, either for a set amount of time, or permanently.
Fail2ban can also alert you through email that an attack is occurring.

Fail2ban is primarily focused on SSH attacks, although it can be further configured
to work for any service that uses log files and can be subject to a compromise.

It is widely used. Searching for it on Google, it’s easy to find
configuration examples for protecting mail servers.

DNS settings to send emails

What domain DNS settings are required to send emails in 2021 ?

Email service providers usually require you to verify the sender’s domain
before using their smtp servers. There are two reasons for this:

1. Prove domain ownership
   by managing the DNS, you prove that you control the sender’s domain
   this means you are not using someone else’s domain (spoofing)

2. Sending of authenticated emails
   by setting SPF and DKIM authentication, your messages
   are recognized by the recipients as coming from a “real” sender
   if your domain and your smtp provider have a good reputation
   the messages should reach the recipients’ inbox

Summary:

• Email service providers: requirements for verified senders
• Why is a verified sender so important?
• What is domain alignment?
• CNAME record and TXT record, which one is best?
• What is a dedicated IP address?
• Should we manage the company’s domain DNS settings directly?

Email service providers: requirements for verified senders

Below there are some of the major providers we checked, in alphabetical order.
At the end of July 2021, we tested the basic settings required to start sending emails.
The verified domain was “emailperfect.com”. It was registred in 2012 and never used to send emails before.

* = we sent a message to each of the following mailboxes and noted if anything suggested that we check again:
Gmail, Hotmail, Yahoo, Gmx, Aruba, Tiscali, Exchange Online

Why is a verified sender so important?

In 2021 we consider mandatory that the sender’s domain is authenticated
so that the recipient knows that the sender’s email address has not been forged.
Preemptive authentication checking also greatly reduces the risk of abuse of sending systems.

For this reason we have “deleted” a provider from the list:
It does not require the domain validation before allowing them to send messages.

What is domain alignment?

When sending a message, we are dealing with two domains:

1. in the senders’s From address, that is visible to the recipients
2. in the Mail-From address (also called “envelope sender” or “return-path”),
   that is hidden and managed directly by the ESP to receive the bounced mails

The “domain alignment” requirement is summarized in this sentence:
“when a sender authenticates their email using SPF and/or DKIM,
at least one of the domains must align with the sending From domain”

CNAME record and TXT record, which one is best?

For DKIM authentication, a CNAME record is easier to implement.
The same result can be achieved by adding a 2048-bit TXT record but it is more complicated.
In addition, delegation of the DKIM record via CNAME allows your provider
to modify its key when necessary for security reasons.

For SPF authentication using a CNAME record means that the Mail-From address
will be a subdomain managed by your email service provider, such as: bounce.your-company-name.org.
The provider will handle both SPF authentication and bounced messages.

TXT record for SPF authentication is the best choice with email servers such as Zimbra or Exchange,
where each sender receives the bounced messages directly.
There is only one TXT record for domain authentication,
it may be difficult to maintain if you manage multiple smtp servers.

What is a dedicated IP address?

The “Internet Protocol address” or “IP address”
is similar to a telephone number on your home phone or mobile device.

Most SMTP services provide “shared” IP addresses to their customers.
Each time a mailing is sent, a different IP address is assigned.

“Dedicated IP address” means that your email sending IP address will not change over time.
This provides great control over the sender’s reputation that cannot be harmed by the use of others.

Should we manage the company’s domain DNS settings directly?

Not necessarily, because it requires some technical skills.

The company management should be aware that a few changes in the DNS settings
can lead to serious consequences such as:

• bring website visitors to another web server
• redirect incoming messages to a different mail server
• break email authentication so that messages are considered as spam or rejected

» back to top

how to manage MAILING LISTS

How to manage mailing lists with foresight in 2021 ?

1. First of all: why use a mailing list manager?
   
   CRM systems (such as Salesforce and Microsoft CRM)
   and business emails (such as Office 365 and Google Apps Gmail)
   they are not suitable for mass mailings.
   
   They were created for one-to-one communication.
   Often to avoid abuses they impose daily sending limits.
   
   Many times companies have to send emails to most of their contacts or to some selected groups.
   Bulk mailings must be managed with dedicated systems,
   capable of processing large amounts of messages and automatic unsubscriptions.

2. Second step: where to look for these solutions?
   
   The easy answer is to look at “Saas” - Software as a service - offers
   (Mailchimp is the most famous system, Inxmail is less known, is used by large companies).
   
   Local installation versus cloud services is always an important choice.
   Our reflection is that the local option helps to “regain email control”, which we are promoting.
   
   Even if you decide to use a self-hosted application in the cloud,
   this allows you to easily change supplier while maintaining the same solution.

3. Three osolutions are worth mentioning:
   

• Sendy is mature but “closed source” and paid.
  
  
• Listmonk is open source. Version 1 was released in 2021. It has been developed in Go,
  it comes as a standalone binary and the only dependency is a Postgres database. On GitHub it has 5.4k stars
  
  
• Mailtrain is open source too. The first version was first released in 2016, version 2 in 2021.
  It uses a MySQL database. On GitHub it has 4.8k stars

In search of a clean interface, a list-centered solution, easy to maintain
and easy to restore in case of problems, we have considered listmonk as the best choice.

listmonk is a self-hosted, high performance mailing list and newsletter manager. 
It comes as a standalone binary and the only dependency is a Postgres database.

This is the original announcement on Hacker News:

knadh on July 12, 2019 [–]

Author here. To give some context on why listmonk was built, at work (regulated financial business), 
we have to deliver e-mails, mostly important updates, to 1.5mn+ customers regularly. 
We used phpList for the longest time and then tried MailTrain and Sendy before finally deciding to reinvent the wheel 
after running into a number of issues, of which, a few important ones are mentioned below.

- Performance. Unreasonably long amounts of time to send out e-mails. 
  phpList degraded to the point of taking several days to process a campaign. 
  listmonk can spawn N goroutines (~threads) and push e-mails to multiple SMTP servers. 
  On a commodity ec2 instance, we're able to send 1.5mn+ e-mails in a couple hours.

- Subscriber imports were extremely slow. Direct integration to keep subscribers in sync with external CRMs was cumbersome. 
  Direct DB inserts were complicated due to the complex table structures. listmonk imports 10k records/sec into a Postgres DB on a commodity ec2 instance.

- Segmentation. Often, we have to rapidly segment users by custom attributes and conditions and relay an update to them. 
  listmonk supports SQL expressions to segment users on their attributes that are defined as arbitrary JSON maps (thanks to Postgres JSONB type).

- Unavailability of dynamic templates. listmonk templates support Go template expressions so it's possible to write logic in messages to make them dynamic.

Kailash Nadhis a very active developer in the FOSS (Free and Open Source Software) area.
He works at Zerodha, India’s largest stock broker.
The blog of Zerodha’s technical staff is published at zerodha.tech.

Listmonk is well documented for standard use (via web interface) and developers (via api).

The solution is suitable for large lists (up to millions of subscribers) and also for small groups.
Thanks to the Querying and segmenting subscribers feature,
it lets you query and export a selection of subscribers based on their profiles and attributes.
The extracted data can be easily imported in a new targeted mailing list.

It lacks certain important features like email bounce handling.
But it should be available in the next major release:
Bounce processing #166
Bounce processing screenshot preview

We used another Go application in the past: RealSender - DMARC REPORTS.
Source: dmarc-report-converter. It worked immediately with no hassle.

"PostgreSQL database management system with over two decades of development behind it, 
is now the most advanced open-source database available anywhere."
-- A Brief History of PostgreSQL - https://www.postgresql.org/docs/9.3/history.html

We had a little experience of that when working in the past with Inxmail Professional server installation.
In 2017 Inxmail GmbH announced that they’ll support PostgreSQL only, dropping all the other DBs:

From 1 January 2019, we will focus on the optimal technical basis and discontinue support 
for Windows servers as well as MySQL, Oracle and MS SQL Server databases.
This means that we will only offer support for Inxmail Professional based on Linux servers and PostgreSQL.
-- Inxmail Professional licence solution: Changes to our system support
   https://www.inxmail.de/files/files/de/downloads/Inxmail-Professional-licence-solution-EN.pdf

It is certainly a good choice and an investment in valuable knowledge for newbies.
Udemy online courses can help with the initial installation and maintenance of PostgreSQL.

Open source has risks: will a recent project, launched in 2019, be maintained in the future?
Nobody knows, maybe in the worst case some other developer will take care of it, but:

• it seems essential in its characteristics, if too complex it becomes difficult to maintain
• we submitted a bug report for listmonk and received a response from the developer within two hours
• the author works in a large company that uses it internally

Email Deliverability, question and answer:

hemancuso on July 12, 2019 [–]
Projects like this seem like a great idea, but deliverability seems like a big concern 
that is hard to measure unless you have a reasonable amount of experience.
What are best practices for using/selecting an ESP 
if you were to use a project like this and want to ensure reasonable deliverability?

knadh on July 12, 2019 [–]
Author here. We've been using listmonk in production at our company (regulated financial business) 
to deliver e-mail updates including regulatory ones for over 6 months. 
We host our own SMTP instances using Postal on EC2 instances and have never had any issues with deliverability. 
If it's legitimate e-mail, I don't think it's much of an issue.

We agree that sending expected communications to customers should help avoid most delivery issues.
In our experience, the larger the number, the more likely there will be drawbacks.
AWS EC2 servers are often blacklisted in Gmail - all sent messages are delivered to the Spam folder.

RealSender offers dedicated ip smtp servers,
that operate in a reliable and constantly monitored environment.

goberoi on July 13, 2019 [–]
Totally random question: how did you pick the name?

knadh on July 13, 2019 [–]
I can't quite recollect, but I think the thought process was along the lines of 
"hassle free, peaceful list management".

You can get a working demo installation in minutes using the docker image.
Alternatively ask RealSender a listmonk demo account.

» back to top

how to send NEWSLETTERS

How to send newsletters in 2021 ?

After blacklisting, the customer support of a major anti-spam service often replies:
“please audit your list hygiene to ensure recipients interest in your mailings”.

“list hygiene” and “recipients interest” have many facets:

A - on the MACHINE side - “list hygiene”

1. well managed subscriptions and unsubscriptions
   the subscriber must have validated her/his email address (double opt-in),
   recipients should be able to easily and with certainty unsubscribe (opt-out)

2. send to “active” and fully engaged recipients only
   do not repeatedly send to bad / mailbox full recipients
   stop sending to inactive recipients, if they do not interact, is a clear signal of no interest

3. the content must be well paginated (not a single image) and “responsive”, so as to be readable on multiple devices
   otherwise, spam filters may block the message before it reaches the recipient’s inbox

4. make sure the machines recognize who is sending
   email authentication allows destination mailservers to identify messages as being sent by trusted senders

B - on the HUMAN side - “recipients interest”

1. subscribers should expect the content they receive
   recipients should be looking forward to your message and appreciating it

2. user responses should be managed
   sometimes something goes wrong or just some recipient needs to communicate with you,
   maybe just to tell you that he doesn’t want to receive any more messages, even if there is an unsubscribe link

MACHINE side - “list hygiene”

The points listed above can be easily managed for small lists, with a few hundred recipients.
Often the sender knows them individually, because they are customers or members of an association.

Things get complicated when the list is larger, with thousands of recipients
and there are more people working on the mailings.
In this case it is mandatory to use professional tools.

On the internet there are many professional solutions for email marketing,
the best known internationally is MailChimp
many websites also list MailChimp alternatives.

EmailTrends’ mission is “to take back email control”,
for this reason we suggest an alternative way.

According to W3Techs, WordPress powers 40% of all the websites on the Internet
and it’s the most popular technology on the Entire Internet in Open Source category.

With over 200,000 active installations, Mailpoet
is one of the most used Wordpress plugin for newsletters.

MailPoet is open source software and from the end of 2020
is part of the companies connected to Automattic, the parent company of Wordpress.

Some screenshots may give you an idea of how the various points are met:

Mailpoet has a “freemium” profit model, which allows you to choose the option:
“I just want the Premium with no sending”.

RealSender dedicated smtp server can be configured via the “Send With… > Other” option.
The “Bounce Handler MailPoet” plugin together with the newsletter mailboxes provided by RealSender
will guarantee the correct authentication of the email messages sent.

» back to top

HUMAN side - “recipients interest”

The human side is harder to achieve,
it is also the point that makes the difference
when the technical management is not perfect.

“BE RELEVANT”
is a slogan used a few years ago in email marketing.

When you send valuable information to people
you know deeply after talking to them for a long time,
it doesn’t matter how bad the formatting is
or if the message goes to the spam folder.

They will always forgive technical imperfections,
they’ll be waiting for your emails, read them
and click the “not spam” button if necessary.

» back to top

how to send PRIVATE EMAILS

How to send private and encrypted emails in 2021 ?

Email is not private or secure.
It wasn’t designed with privacy or security in mind.

Anyone who handles your email in transit can read it,
including your ISP, a hacker, or the NSA (U.S. National Security Agency).

Summary:

• email privacy: what is happening today
• on the “legal” side
• on the “illegal” side
  
  
• email privacy: the challenges
• Anonymity and Confidentiality
• End-to-End Encryption
  
  
• email privacy: the solutions
• < technical >  Pretty Good Privacy - also known as PGP
• < technical >  How to use PGP encryption
• < easy >  Alternatives to PGP encryption

what is happening today

on the “legal” side

“The value of any piece of information is only known when you can connect it
with something else that arrives at a future point in time.
Since you can’t connect dots you don’t have, it drives us into a mode of,
we fundamentally try to collect everything and hang on to it forever.”

• -  CIA’s Gus Hunt On Big Data, on The Huffington Post
• -  CIA’s Gus Hunt On Big Data, on Youtube

“They’ve said it’s just metadata, it’s just metadata, […]
who you’re talking to, when you’re talking to them, where you traveled.
These are all metadata events.
PRISM is about content. […] They can all see it because it’s unencrypted.”

• -  Edward Snowden - TED 2014

There are dozens of psychological studies that prove
that when somebody knows that they might be watched,
the behavior they engage in is vastly more conformist and compliant.
[…] mass surveillance creates a prison in the mind […]

• -  Glenn Greenwald - TEDGlobal 2014

on the “illegal” side

Scammers might also use malware to infiltrate a company’s computer network
and access email exchanges about financial matters.

• -  Fraud Resource Center - Business Email Compromise

Business email compromise (BEC)—also known as email account compromise (EAC)
is one of the most financially damaging online crimes.
In a BEC scam, criminals send an email message that appears to come from a known source
making a legitimate request […]

• -  Scams and Safety - Business Email Compromise

back to top

the challenges

Anonymity and Confidentiality

Anonymity is different from confidentiality
[…] we’re encrypting messages
so that even if people see that we’ve sent a message
they can’t read what it is
but sometimes we don’t even want people to see that we sent a message at all

• -  How TOR Works - Computerphile

Internet anonymity is difficult to achieve.
It requires a deep knowledge of the tools you decide to use.

This guide might give you an idea of its complexity:
Private Email Providers

Confidentiality is easier to get.

Even if you have nothing to hide, using encryption
helps protect the privacy of people you communicate with
and makes life difficult for bulk surveillance systems.

If you do have something important to hide, you’re in good company;
these are the same tools that whistleblowers use to protect their identities
while shining light on human rights abuses, corruption and other crimes.

The essential first step is to protect yourself
and make surveillance of your communication as difficult as possible.

• -  Email Self-Defense - a guide to fighting surveillance with GnuPG encryption

End-to-End Encryption

End-to-end (e2ee) encryption for email can be used to ensure
that only the sender and the recipients of a message can read the contents.

Without this protection it is easy for network administrators,
email providers and government agencies to read your messages.

Achieving e2ee requires carefulness by both the sender and the recipients.
A single mistake by any of the involved parties can be sufficient to break the security of e2ee.

Email metadata, such as sender email, recipient email, date and time, cannot be protected using e2ee.
The subject of the mail may also remain unprotected and easily readable, even when e2ee is used.

• -  What is End-to-End Encryption in Thunderbird?

back to top

the solutions

< technical >  Pretty Good Privacy - also known as PGP

PGP software follows the OpenPGP standard of encryption,
standard (RFC 4880) for encrypting and decrypting data.

• -  Pretty Good Privacy on Wikipedia

PGP encrypts your email body into a code
that only the right person can read.

PGP runs on pretty much any computer or smartphone.
It’s freely licensed and costs no money.

Each user has a unique public key and private key,
which are random strings of numbers.

Your public key isn’t like a physical key, because it’s in an online directory, where people can download it.
People use your public key, along with PGP, to encrypt emails they send to you.

Your private key is more like a physical key, because you keep it to yourself (on your computer).
You use PGP and your private key to decode encrypted emails other people send to you.

If an email encrypted with PGP falls into the wrong hands, it’ll just look like nonsense.
Without the real recipient’s private key, it’s almost impossible to read it.

To protect ourselves form surveillance, we need to learn when to use PGP
and start sharing our public keys whenever we share email addresses.

• -  Email Self-Defense - Infographics

< technical >  How to use PGP encryption

To use PGP, you’ll need a public key and a private key (known together as a keypair).
Each is a long string of randomly generated numbers and letters that are unique to you.
Your public and private keys are linked together by a special mathematical function.

An application that manages the keys and the encryption/decryption of messages is required,
this is a selection of the most popular ones:

• Mailvelope is a free, open source, browser-plugin, available for Mozilla Firefox and Google Chrome,
  it’s probably the easiest way to approach PGP
  “Mailvelope Demonstration” is a well done tutorial

• Mozilla Thunderbird application integrates everything needed to send PGP signed messages
  Introduction to End-to-end encryption in Thunderbird

• GnuPG is a complete and free implementation of the OpenPGP standard
  A Noobs PGP Guide using Gpg4Win [Easy 5 Min Setup] explains how to use it

< easy >  Alternatives to PGP encryption

PGP is the best solution for secure communications with a partner that is already using it.
Asking your counterpart to start using PGP could be hard.

The services that allow you to share a secret only once are an alternative.

When sending something a single time, there are open-source web apps
that allows you to enter information that can only be viewed once.

After the recipient has opened the page, the information is deleted,
and the only thing remaining in your chat logs or email is a bad link.

It’s not as robust as your entire team using PGP, but it’s much easier to set up or explain.
We’ve been able to use it to send login information to fairly non-technical people, and they find it easy to use.

Example (without adding a password):

Let's say you have a password. You want to give it to your coworker, Jane. 
You could email it to her, but then it's in her email, which might be backed up, 
and probably is in some storage device controlled by the NSA.

If Jane gets a link to the password and never looks at it, the password goes away. 
If the NSA gets a hold of the link, and they look at the password... well they have the password. 
Also, Jane can't get the password, but now Jane knows that not only is someone looking in her email, 
they are clicking on links.

Some of these services, all free and opensource, are listed below.
You could also decide to host an instance on your own webserver.

PrivateBin (like a secure version of PasteBin) is developed in PHP
PrivateBin code is published on Github - 3100 stars
PrivateBin instructions are available on a different website

OneTimeSecret is developed in Ruby
OneTimeSecret code and instructions are published on Github - 1200 stars

SnapPass is written in Python. It was originally developed by Pinterest

SnapPass code and instructions are published on Github - 600 stars

back to top

how to send and limit BCC EMAILS

How to send and limit Bcc emails in 2021?

“Cc” means “Carbon Copy” in the (old) sense of making a copy
on a typewriter using carbon paper.

The “Bcc:” field in emails (where the “Bcc” means “Blind Carbon Copy”)
contains addresses of recipients of the message
whose addresses are not to be revealed to other recipients of the message.

• • IETF rfc 2822 “Internet Message Format”

The difference between Bcc and Cc lies in the privacy of the recipient.
Using the Cc feature, the email addresses in the Cc field
are visible to all the recipients of the email.

A Bcc recipient can see the direct recipient (To:),
he won’t be able to tell who else was Bcc’d in the email.

Bcc is often seen as an easy-to-use mass email distribution system.
Below is a brief analysis of the pros and cons of using Bcc.
At the end of the page, the conclusions with some suggestions.

PROS

It’s easy: anyone can use it.

• it’s an easy way to contact multiple email recipients
• anyone with an email client can utilize it
• when used correctly, it respects the recipients’ privacy by not disclosing their email IDs

back to top

CONS

Email is an outgoing gateway without prior checking.
Bcc increases its reach to hundreds or thousands of contacts.

Bcc should be considered a high risk,
potentially dangerous communication tool.

• it’s an error-prone process, the risks are:
• mistakenly add Bcc recipients in the Cc field
  this usually causes severe brand damage
  a new apology message is the most common way out of this situation
  » the names of all the recipients are made public
  » unintended (and sometimes intentional) use of “reply to all”
     which generates uncontrolled email chains
  » someone might raise a privacy incident from a GDPR perspective
     if the subject/body contains “special categories” of personal data, thus identifying
     the people that belong to the same category (i.e. illness, orientation or beliefs)
• mistakenly add someone as the main (visible) recipient
• forget to add someone or add someone that should not receive the message
  
  
• there is a high probability of being classified as spam
• the problem is, most spammers send using Bcc
  the destination mailservers are cautious in accepting Bcc messages
• if I send you a message using Bcc,
  you receive an email that is not addressed to you
  that’s a mark against the message when it comes to evaluating spam
• the same message will be sent to “several” email addresses
  belonging to the same domain all at once, it’s easy to count them and block it
  
  
• there is no control over wrong addresses
• there may be double/triple email addresses in the same recipient
  this affects the sending to that recipient, even if one or more addresses are correct
• syntactically incorrect addresses are accepted without warning
  for example, if the @ symbol is missing or there are spaces
  
  
• no personalization / low impact / little or no reactions
• the message will necessarily be standard and “anonymous”
  no individual communication is possible, no Dear Mr./Mrs. …
• your Bcc’d recipients will receive a message directed to someone else
  they are unlikely to pay attention or react to it
  
  
• it is very likely that there will be technical problems
• any abuse actions by spammers or hackers may quickly impact many recipients
  compromising the reputation of the smtp server (i.e. server blacklisting)
• sender mailbox could be overrun by bounces (user unknown, mailbox full, …)
  their number can vary between 5% and 20% of the emails that have been sent
• the sending may have a bad impact on email delivery systems (smtp servers), i.e.:
  many “try again later” replies, large number of messages the mail-queue, system crash
  
  

back to top

CONCLUSIONS

1. Set the Limits

• check the number of recipients allowed by your email provider
  try it yourself, to be 100% sure
  
  RealSender.com shares a list of 300 @spam-box.com addresses for testing,
  the messages will reach a “black-hole” mailserver
  
  
• limit the number of recipients in a single message to a small number, such as 20,
  allowing more recipients, permits to easily send messages
  to thousands of email addresses, just dividing them into small groups

2. Go Professional

• allow massive emails through different channels only
  
  
• use a different From address when sending many messages
  for example another subdomain, as @news.companyname.com
  only authorized persons will have access to it
  and they will handle it more carefully
  
  
• within structured offices, with many people working with email,
  use dedicated apps to send mass mailings
  the professional systems have an approval workflow
  and step by step control, they are designed to avoid mistakes

back to top

measure EMAIL MARKETING

How to measure the performance of your email marketing campaigns in 2021.
The following information comes from our fifteen years of experience
with the Inxmail email marketing platform.

What are “email marketing campaigns”?
They are massive permission-based emails,
whose contents are generally customized according to the interests of the recipient,
where the sender can obtain feedback data based on the behavior of the recipients.

• email marketing campaigns
• permission-based marketing

The answers or “feedback data” are the basis for the metrics
behind the reports on the performance of email marketing campaigns.
Let’s outline what they are and how they are measured:

• tracking user reactions
• two levels of permissions (privacy-related issues)
• how user tracking works
• how the open rate measurement works

The best technical tools are useless if the messages do not reach the recipient’s inbox.
This is where “email deliverability” comes into play:

• email deliverability
• seed emails
• bounce rates
• email marketing benchmarks

email marketing campaigns

permission-based marketing

Permission-based marketing, also called “dialogue marketing”,
is a concept introduced by Seth Godin in 1999 in his best-seller “Permission marketing”.

In the book, it is defined as the opposite of “Interruption marketing”
generally used in traditional mass media such as TV and newspapers.

Aims to create a personal and direct communication,
a relationship between the two parties and activate a “human” dialogue
whose experience is useful and enriching for both.

back to top

tracking user reactions

two levels of permissions - privacy-related issues

Depending on the privacy permissions collected, the sender can record:

• aggregated data
• data of the single user (e.g. who opened the email, who clicked)

Aggregated data
they provide global feedback and information on general trends
(e.g. how many opened the email, how many clicked)

Single user data
they allow to obtain individual information
by collecting personal data and then sending personalized messages,
based on previous interactions and user behavior

back to top

how user tracking works

Link tracking is the activity to replacing the final URL of the website
with a fictitious address, which records the visit and redirects the user to the destination page.

Within email messages, only clicks on links can be tracked.
external images, those that the email client asks for confirmation before downloading,
are treated as links, so you just need to track an external image URL
to know the email opening rate.

Tracking usually only records the “mailid”,
a unique identifier of the mailing that has been sent.

Personalized tracking is achieved by adding to the visited pages
one or more parameters generated by the software,
such as: example.com/test.html?id=54725788327466628654
the “id” parameter refers to a specific user and a particular link in the message.

The information obtained can automatically
update the recipient’s data in the email marketing application
or pass the details on the origin of the click to the web analytics platform.

For example: a travel agency could measure
how many times the user clicks on sea or mountain news,
increasing a specific counter over time.
The data collected will indicate the recipient’s preferred destination.

back to top

how the open rate measurement works

Open rates are measured by combining data from clicks on tracked links
and “hidden clicks” generated by tracked images that have been downloaded.

If a message is opened in the email client preview,
without downloading the images or clicking on any links,
it is not possible to know that it has been opened.

Since 2003 initially Outlook, then most email clients,
to protect the privacy of their users
began to block the automatic download of images
which otherwise would have been tracked for each email read.

Since 2013, images in Gmail are displayed automatically by default.
The download is performed by a third server, called a “proxy”,
which masks the user’s terminal, but still allows the email marketing operators
to know that the image has been downloaded and the message opened.
Further information can be found here:
How the new Gmail image proxy works and what this means for you

Registration of opening rates is not accurate,
provides a lower value than actual openings.
It is a good idea to measure it anyway,
even just to compare the results of different campaigns.

back to top

email deliverability

seed emails

First of all it is necessary to check if the emails arrive in the mailboxes
of the main freemail domains present in your list
and also in the inbox of the two main suppliers of corporate mailboxes:
Google Apps and Office 365.

Content-activated spam filters are generally triggered by domains present in URLs (http …)
a good tip is to use only one domain in the links of your messages.
The domain should be the same one used in the sender address;
it is called “domain alignment” and reduces the risk related to phishing filters.
For the same reason, if links are tracked, they should use a subdomain
of the domain used in the sender address.

Real tests can be done simply by activating a “seed” mailbox for each email provider,
and then activate the forwarding of messages to your email address.
Send each mailbox a message with the subject “Test Message”
and the content “Test Message” plus the link to your domain.
If the message passes the spam filters, you should receive it in your inbox.

back to top

bounce rates

It is normal to receive bounced emails.
The reason may be the presence of abandoned addresses,
full mailboxes or other technical issues.

Depending on the “cleanliness” of your list,
the bounce rate can vary between 5% and 20%.

As the numbers grow, it becomes impossible to manually manage the bounced emails.
Email marketing applications integrate a feature called “bounce handler”
which automatically downloads rejected messages,
it analyzes and classifies them according to their content.

The destination email address is automatically disabled
after a number of “hard bounces”, persistent errors such as user unknown and host unreachable
or after a greater number of “soft bounces”, transient errors such as mailbox full.

It is important to monitor the “bounce rates” (rejected messages)
or the complementary “delivery rates” (messages accepted). Their sum will give 100%.
A change in their value is a symptom that should be investigated.

back to top

email marketing benchmarks

The biggest email marketing platforms publish benchmark numbers
that are based on the data collected by all their customers.

Technical terms used in the reports:

• Openings: number of recipients who have clicked
  on at least one tracked link or opened at least one tracked image
• Open Rate: Openings / Number of recipients (net of bounces)
• Unique Clicks: number of recipients who have clicked on a link at least once
• Click Through Rate (CTR): Unique clicks / Number of recipients (net of bounces)
• Click To Open Rate (CTOR): Unique clicks / Openings

Here is a short list, most of them refer to the U.S.:

• Mailchimp customers range from 1-person startups,
  small businesses to “Fortune 500” companies,
  the whole spectrum is represented in this data

• Email Marketing Benchmarks and Statistics by Industry

• Campaign Monitor analyzed over 100 billion emails sent globally
  between January and December 2020

• Email benchmarks by industry and day

• Compare benchmarks between regions

• Return Path eighth annual deliverability benchmark report
  to see how many emails were delivered to the inbox, spam, or blocked.
  
  the 2020 Deliverability Benchmark Report (PDF) contents:

• What is deliverability and how it’s measured?

• What can happen to an email after you hit send?

• Globally, how many emails land in the inbox and the spam filter on average

• Deliverability statistics for 30 individual countries

back to top

what is considered SPAM

What users and mail servers qualify as spam emails in 2021.

Starting from our experience with RealSender,
we have tried to summarize the main points that could affect inbox delivery in 2021.

• USERS reactions
  the messages should be expected/desired by their recipients
  
  
• technical points
  basic setups are required to get the email messages accepted
• IP address and IP class reputation
• correct smtp server SETUP
• proper email AUTHENTICATION
• SPAMASSASSIN check
  
• TRY and see what happens
  The only surefire way to see if an email is classified as spam is to…
  send it, and see how it shows up on the other side.

It is useless to evaluate the other points
if the messages are not expected/desired by their recipients.

USERS reactions

The sender should put himself in the recipient’s shoes, trying to figure out how an email message will be treated.
User complaints can lead to the blacklisting of the entire smtp server or of the domain name, affecting the delivery of all future messages.

• users generally* can manage their inbox: it is “spam” what every single user considers spam
  * = many freemail providers DO NOT give the option to opt-out of their “internal advertising”
• the user expresses his choice by clicking the “Report Spam” button (within Gmail)
  or the “Junk” button (within Outlook/Hotmail)
• the spam filters of modern mail servers are all connected to user complaints, after a certain number of clicks on “Report as Spam”,
  all messages with similar content will be delivered directly to the Spam folder

Basic technical settings are required to get email messages accepted.

IP address and IP class reputation

• smtp server IP blacklisting, you can find a lot of tools online googling for “blacklist check”
• smtp server IP class reputation, check our blog article for more information SMTP IP REPUTATION MATTERS
• if the messages are sent from a personal computer, the reputation of the public IP address of the Internet connection should also be checked
  (some smtp server providers mask the IP address of the internet connection, so that the recipient’s system only sees their IP address)

correct smtp server SETUP

• reverse DNS
  to make sure the IP address of your mail server points to the domain name that you use for sending mail
• the mail transfer agent, the application that routes and delivers email,
  should be properly configured, following the latest RFC published by IETF
  see for example: Making Postfix RFC Compliant

proper email AUTHENTICATION

Use email authentication methods, such as SPF and DKIM, to prove that your emails and your domain name belong together.
The nice side-effect is you help in preventing that your email domain is spoofed.

• SPF, a path-based email authentication protocol that allows email receivers to determine if the sender is authorized to use the domains in the message’s header by evaluating the IP address of the sender’s outbound MTA based on information published by the sender in DNS TXT records. SPF is defined in IETF RFC 4408.
• DKIM, an email authentication protocol that enables the sender to use public-key cryptography to sign outgoing emails in a manner that can be verified by the receiver. DKIM is defined in IETF RFC 4871. The DKIM standard is adopted by Gmail and other large corporations to completely eliminate phishing and spoofing from internet mail.
• DMARC, relies on the established SPF and DKIM standards for email authentication. Destination mail servers take action on unauthenticated mail, based on the sender “dmarc policy” and report on the outcome to the sender. DMARC is defined in the Internet Engineering Task Force’s published document RFC 7489.

SPAMASSASSIN check

• SpamAssassin is a server side software, used for email spam filtering. It uses a variety of spam-detection techniques.
  Each test has a score value. The scores can be positive or negative, with positive values indicating “spam” and negative “ham” (non-spam).
  The default score threshold for the recipient is “5.0”. If an email score lands higher than the threshold, is marked as spam.
  It is so widely used that the score check before sending email messages should be considered mandatory.
• two online tools can help you to check your SpamAssassin score: isnotspam and mail-tester
  1. you have to send the message to the email address provided
  2. after a few seconds click the “view your report” or the “then check your score” buttons

The only surefire way to see if an email is classified as spam is to…
send it, and see how it shows up on the other side.

TRY and see what happens

• If you receive a bounced message, this can be of great help, because the last few lines usually describes the problem that caused the rejection.
  If the explanation is incomprehensible, simply try sending a message with subject and content “Test message” and check if it is accepted.
  In this case, you should send the same message several times, reducing the content gradually, until you identify which part activates the spam filter.
• Having a detailed sending log, can help you to verify if the messages are accepted of rejected
  examples of information available in the log
• In some (rare) cases a sort of “whitelisting” is required.
  Some spam system learns from what users do with the messages they receive.
  If the individual recipient flags once the received mail as NON spam,
  it will learn that they are valid messages and will begin delivering them in the “Inbox” folder instead of “Junk”.
  Alternatively, the sender must be in the address book of the recipient or have previously exchanged emails with him.

open source EMAIL CLIENTS

How to regain email control in 2020 using ready-to-run open source email clients.

Over the past decade, we’ve seen an almost complete change in corporate mailboxes
from on-premises mail servers to cloud services like Exchange Online (Office 365) or Gmail for business (Google Apps).

The main reasons for it are:

• the need to access emails from mobile and web interfaces
• the need to protect mailboxes from spam and malware

In this way, the life of IT professionals has been simplified by offloading
the responsibility to manage the email infrastructure on the “big tech players”.

The risk of abandoning basic email skills, can lead us to think about email
as something that works magically, just because Microsoft and Google handle it.

We can regain email control by breaking down the messaging components and managing them individually:

• the incoming mailserver
• the email client
• the outgoing mailserver

This creates service isolation and segmentation and tremendously benefits security.
Thus, decreasing the attack surface through isolation/segmentation is considered best practice.
Furthermore, it increases the scalability and stability.

Email clients are the primary interface of mailboxes. They’re a complex piece of software that interacts with users.

There are many solutions available on the market, we have selected them based on two requirements:

• multi-platform, actively managed and open source projects
• ready to use, so that system administrators can easily manage them

We came up with two choices:

1. Mozilla Thunderbird is an open-source, cross-platform email client for personal computers. Developed by the Mozilla Foundation.
   It supports both IMAP and POP (storing mail locally on your hard drive so that it can be accessed without an internet connection).
   It features excellent mail filter capabilities and management.
   
   Thunderbird has strong support for using multiple accounts and identities, including automated signature features.
   It comes with ready-to-install versions for: Windows, Mac OS and Linux. To gain access remotely, users must first connect to their computer.

2. The new Rainloop fork, is a simple, modern, lightweight & fast web-based email client.
   It can handle large number of email accounts without the need of any database connectivity.
   It holds both SMTP and IMAP protocols to easily send/receive emails without any trouble.
   
   In 2020, the SnappyMail Github project has been published.
   It is the drastically upgraded & secured fork of RainLoop Webmail Community edition.
   Here is the SnappyMail email client demo. If you want to try the Admin interface, contact us.

work EMAIL and PRIVACY

Warning: this is a topic with strong legal implications.
Contact qualified consultants to verify the regulations and their application.

The work email is a business work tool
which contains an impressive amount of business-related information.

The companies can do whatever they want with the email,
which is a business work tool, but is it written and read by employees?
Can they read it? Can they backup it? Can they archive it?

Summary:

• two types of work email addresses
• generic work email addresses, no constraints
• personal company mailbox, such as company cars
• behavioral guidelines
• read only under certain conditions
• inform the employee
• massive checks are prohibited
• legal requirements
• obligation to archive email messages
• obligation to inform the employee
• obligation to delete email messages
• obligation to deactivate the mailboxes

generic work email addresses, no constraints

The work mailbox has an ambivalent nature,
it is a tool owned by the employer, but is used by the employee.

We must distinguish between two different types of business email addresses:

• personal company mailbox, i.e. name.surname@companyname.com
• generic company mailbox such as info, support, sales, marketing, billing, etc.
  that is, all those that are NOT related to a single person

The generic company mailboxes are not problematic at all,
the company checks them, reads all the messages, has no constraints.

personal company mailbox, such as company cars

The personal mailboxes, such as name.surname@companyname.com,
may contain personal data of the employee that the employer must protect.

If we choose to use this kind of mailbox,
as an employer we need to know which technical standards to adopt
and which tools to use to be able to process the data adequately.

The mailbox can be compared to the company car,
it is made available to the employee for use within the business tasks.

The employer for example can check the mileage, to verify that the employee
has not abused this work tool, using it for personal purposes.

The employer can not, however, monitor systematically and without specific reasons
what the employee does inside the company car.

The mailbox is the equivalent of the company car, a work tool that is owned by the company,
given to the employee to use it use it for work, just to carry out its tasks.

What the employee sends and receives, even during working hours, is like what happens
inside the cockpit of the company car and is equated to private correspondence.

back to top

read only under certain conditions

The company cannot read what is written in the email messages,
it cannot be done systematically and without a specific reason.
Even if there is a specific motivation, it can be done only under certain conditions.

Three different interests are at stake, which must be balanced:

• the employer’s interest in accessing this content
  for organizational/production, work safety or other reasons
  
  
• the legitimate expectation of employees
  who consider this content as confidential
  
  
• the expectation of third parties who write to that company name account
  they may not be aware that the content of their correspondence is NOT private and confidential.
  (the standard disclaimer at the bottom of email messages usually warns that the content may be read by others)

inform the employee

The employee must be informed, with adequate written communication, that the email messages
can only be used for all purposes related to the employment relationship, for example by prohibiting personal use.

The document must contain how to use the company tools,
including the email box, and inform that, in compliance with the privacy regulations:

• email messages will be archived to comply with the law and to protect company assets
• the company may, in some cases, carry out checks on the content of the employee’s mailbox

massive checks are prohibited

The so-called “massive controls” are prohibited,
such as the systematic reading of the contents of an employee’s mailbox.

Limits in employer control are based on three cardinal principles:

• one is good faith, which is the possibility for the employer to carry out a check
  on the employee’s company mailbox only if there is a well-founded reason
  for example, for the protection of company assets that could be compromised or put at risk by a virus;
  or in the case of suspected infidelity of the employee, to carry out defensive checks

• the others are proportionality in the control and limitation in time and in the object of the research

back to top

obligation to archive email messages

The rules require that the employer must prove
to have adopted adequate and effective security measures
to protect company data, such as corporate email archiving.

obligation to inform the employee

Access to data by the employer
if carried out in the absence of detailed company information:

• represents a very serious violation
  
  sensitive data may be found in the employee’s personal space,
  for example information about political, religious, sexual or trade union trends,
  which must be guaranteed at the highest level of confidentiality

• it is a criminal offense
  
  there is also the risk for all illegally acquired data
  to be unusable in any legal process

obligation to delete email messages

Business correspondence should generally be kept for a maximum of ten years.
To preserve the company’s assets and to be able to defend itself in any litigation situations.

The storage and processing of personal data is permitted only for a specific purpose.
If this purpose ceases to exist after a certain period of time, for example after ten years, this data must be deleted.

obligation to deactivate the mailboxes

In the event of employee dismissal or resignation,
the name.surname mailbox must be deactivated within a short period of time.

The company can activate an automatic reply informing the sender that the account has been deactivated,
inviting him to write to another internal email address.

The historical archive of company messages of terminated employees
can be kept only if the employee had been informed that his messages were stored.

back to top

protect emails from SPAM

How to protect business emails from spam in 2020.

It is almost impossible to think about email without considering the issue of spam.
We tried to summarize the current situation and the strategies that can be followed:

• How much email traffic is spam?
• What are the costs of spam?
• What are the latest anti-spam techniques?
  • Spam prevention (before it happens)
  • Spam cure (while it’s happening)

How much email traffic is spam?

A reputable source is SenderBase, now called Talos,
showing about 85% spam email and 15% legitimate email
compared to the email traffic recorded in September 2020.

This percentage has been stable, with little changes in the last twelve months.

Source: Email & Spam Data - Total global email & spam volume.

back to top

What are the costs of spam?

Sometimes spam is just for promotional purposes, and the sender
is merely trying to generate more customers for his business,
causing distractions and loss of time. It can fill your inbox
so that it’s difficult to find emails that are important.

Not all spam are friendly promotional emails.
There are many cases where the intentions are malicious, aiming to damage or hijack user systems.
The most common variants of malicious spam worldwide include trojans, spyware, and ransomware.

back to top

What are the latest anti-spam techniques?

Imagine your company’s inboxes as your house door:
you have to decide who can come in and who you leave out.

No technique is a complete solution to the spam problem.
Each has trade-offs between incorrectly rejecting legitimate email (false positives)
as opposed to not rejecting of spam (false negatives)
and the associated costs in time, effort, and cost of wrongfully blocking good mail.

Anti-spam techniques can be broken into two areas: prevention and cure.

Spam prevention (before it happens)

Restrict the availability of your email addresses, with the goal of reducing the chance of receiving spam.

• Discretion
  
  don’t give your email address to everybody
  the less known it is, the less spam you will receive
  whenever it is possible, use a different email for online registrations

• Contact forms
  
  don’t publish your email address online
  anybody can see it, “spambots” catch them all the time
  to get contacted online, use secure* web forms / contact forms
  * = protected by robots that fill them automatically

Spam cure (while it’s happening)

Once the spammers have your email address, the fight moves to your mail server and inbox.

• SpamAssassin-like score systems
  
  They use several spam-detection techniques including DNS based email blacklists
  (commonly called Realtime blacklist, DNSBL or RBL), text analysis and Bayesian filtering.
  
  Each test has a score value. The scores can be positive or negative, with positive values indicating “spam” and negative “ham” (non-spam).
  The default score threshold for the recipient is “5.0”. If an email score lands higher than the threshold, is marked as spam.
  
  There are a lot of “SpamAssassin Tests” available on the net,
  that let the spammers check their messages before sending them.

• Powered by users
  
  Users of these systems can flag incoming emails as legitimate or spam and these notations are recorded into a central database.
  After a certain number of users mark a particular email as junk, the filter automatically blocks it from reaching the rest of the community’s inboxes.
  
  Sometimes users feedback is integrated with automated controls like the number of interactions with message contents,
  as the amount of click on links and the images downloaded, or the count of the occurrences of the same message in multiple mailboxes.
  
  When a collaborative content filtering system involves a large, active user base,
  it can quickly block a spam outbreak, sometimes within a matter of minutes.
  
  This kind of filter can hardly be overcome by spammers.

• Email Authentication
  
  SPF, DKIM and DMARC are authentication techniques that let you recognize if the from address is really who it claims to be.
  In 2020 they’re widely used and they are a good source to identify the trusted senders.
  
  It is important to know in advance the exact domain the emails are coming from,
  otherwise it is easy to be misled by the simple change of a letter.
  
  It’s possible for spammers to comply with email authentication
  so that their messages look to come from “legitimate senders”.

• Authorized senders, whitelist
  
  In a whitelist one can specify a series of trusted addresses or domains.
  In the beginning the personal address book and the past received emails will be of great help.
  
  If a sender is in this list, all controls are skipped and the message is received without delays.
  This method is easy to implement and very effective when associated with Email Authentication, to avoid email address spoofing*.
  * = use of a fake sender to make the message appear from someone other than the actual source
  
  Once your list of trusted contacts is filled, no unknown sender will reach your mailbox.
  All unwanted messages can be redirected to a different mailbox to be checked once a day or more rarely.
  
  Spammers will hardly find which are the trusted senders of each recipient.
  Even when they do it, email authentication checks will alert you of the fraudulent use.

back to top

how DMARC works - updated

How dmarc works with Google Mail and Office 365 in the autumn of 2020.

We’ve tested again how email authentication affects the delivery
to Google Mail and Office 365 mailboxes, the most popular business emails providers.

The results can be divided into two groups:

emails delivery

(how spf, dkim and dmarc affect the delivery of sent messages)
 
# Google mail: the emails are always accepted, the spf authentication seems not to be considered at all
   Dkim signature is evaluated only if it’s aligned with the From email address and dmarc is set with policy “quarantine” or “reject”.
 
# Office 365: is fully responsive to spf, when a message passes the spf check, it reaches the Inbox.
   Dkim signature is considered only if it’s aligned with the From email address, otherwise it doesn’t matter.
 
   Notes: in the last week of August Office 365 had a strange behavior:
   only the messages signed with dkim (signing domain aligned with the From address)
   and dmarc record set (with any policy), were delivered to the Inbox

spoofing protection

(how spf, dkim and dmarc protect the sender’s email address from being spoofed*)
* = make the message appear from someone other than the actual source
 
# Google mail: activating dmarc, the spoofed senders get filtered to the Spam folder (with p=quarantine) or rejected (with p=reject).
   Nothing happens if the policy is set to “none” (p=none), in this case all the messages reach the Inbox.
 
# Office 365: “spf fail” or “spf softfail” results, are enough to send the fake senders to the Junk email folder.

authentication requirements

the suggested email authentication requirements, are summarized as follows:

email delivery test results

below there is the full range of tests that have been made

Notes:

• the From address (visible sender) and the Mail-from (also said “envelope from” or “return-path”) are the same, they refer to the same domain
• “dkim pass”: the dkim signing domain is the same as the one of the From address (the domain is aligned)
• “dkim diff”: the dkim signing domain is different than the one of the From address (the domain IS NOT aligned)

DKIM domain for DMARC

How DKIM domain alignment affects DMARC authentication in 2020.

DMARC (Domain-based Message Authentication, Reporting and Conformance),
is an email authentication standard, developed to combat spoofed domain mail.

In the chapter “3.1. Identifier Alignment” it says:

   Email authentication technologies authenticate various (and
   disparate) aspects of an individual message.  For example, [DKIM]
   authenticates the domain that affixed a signature to the message,
   while [SPF] can authenticate either the domain that appears in the
   RFC5321.MailFrom (Mail-From) portion of [SMTP] or the RFC5321.EHLO/
   HELO domain, or both.  These may be different domains, and they are
   typically not visible to the end user.

   DMARC authenticates use of the RFC5322.From domain by requiring that
   it match (be aligned with) an Authenticated Identifier.
   
   -- https://tools.ietf.org/html/rfc7489#section-3.1

It simply means:

   when a sender authenticates their email using SPF and/or DKIM,  
   at least one of the domains must align with the sending From domain

It was not clear to us if a message could fail SPF or DKIM check
and still pass the DMARC authentication.

We tested it using a tool available to everyone: a Gmail mailbox.
To see the outcome, open the message and select “Show original”:

Test 1 - forwarded message: spf-fail, dkim-pass (aligned)

Test 2 - broken dkim key: dkim-fail, spf-pass (aligned)

The result is evident, the message passes DMARC authentication if it occurs:
SPF and domain alignment <OR> DKIM and domain alignment

To pass the DMARC check, in some cases it is therefore important to validate the DKIM signature:
the signing domain (d=example.com) must be aligned with the From domain.

Examples of “DMARC-PASS” results that otherwise would not have worked:

Case 1 - forwarding breaks the SPF authentication

• SPF-FAIL: SPF Authentication checks will mostly fail,
  because a new entity, not included in the original sender’s SPF Record, sends the forwarded email

• DKIM-PASS (aligned): Email forwarding does not affect the DKIM signature

Result: DKIM alignment allows the message to pass the DMARC check.

Case 2 - the SPF domain provided by the ESP (Email Service Provider)
CANNOT be aligned with the From domain

• SPF~PASS (NOT aligned): SPF Authentication fails domain alignment,
  since the domain used by the ESP within the Mail-From address is different by the one in the From sender

• DKIM-PASS (aligned): DKIM signature uses the same domain of the From sender

Result: DKIM alignment allows the message to pass the DMARC check.

most popular EMAIL PROVIDERS

Which are the most popular email providers in 2020.

To monitor email deliverability, it is important to know which email providers your recipients are using.

Busines to Business

For B2B world we don’t have precise numbers. The most part of business mailboxes are moving to “Cloud Office Suites”, where the market is divided among “G Suite” and “Office 365”.
Together they cover more than 90% of global business email market share, according to datanyze.com data.

Gathering this information for a single business is quite easy.
From the mx record of the company domain, we can see the email provider being used:
aspmx.l.google.com for “G Suite”
mail.protection.outlook.com for “Office 365”

If your company works in B2B, it is recommended that you regularly monitor a mailbox for each of these two providers.

A third player is Zoho (mx.zoho.com), its market share is around 2% (source: ciodive.com).

Busines to Consumer

With B2C the analysis is more complex. There are no public “email open data” based on the internet traffic.

The only way to get information on email recipients is to extract them from our contact list or to get them by big email service providers. Some of them produce yearly reports to share them with the internet community.

The data below show the top three email providers in twenty-five countries, the information comes from the “2019 Email Benchmark and Engagement Study” published by Sendgrid.

Countries

Argentina, Australia, Belgium, Brazil, Canada, Chile, China, Colombia, Denmark, France, Germany, India, Indonesia, Italy, Japan, Mexico, New Zealand, Russia, Saudi Arabia, Spain, South Africa, Sweden, Switzerland, United Kingdom, United States

Argentina

back to top

Australia

back to top

Belgium

back to top

Brazil

back to top

Canada

back to top

Chile

back to top

China

Note: information taken from “Country overview: China” by ReturnPath

back to top

Colombia

back to top

Denmark

back to top

France

back to top

Germany

back to top

India

back to top

Indonesia

back to top

Italy

back to top

Japan

back to top

Mexico

back to top

Netherlands

back to top

New Zealand

back to top

Russia

back to top

Saudi Arabia

back to top

Spain

back to top

South Africa

back to top

Sweden

back to top

Switzerland

back to top

United Kingdom

back to top

United States

back to top

how DMARC works

How dmarc works with Google Mail and Office 365 in 2020.

We’ve tested how email authentication affects the delivery
to Google Mail and Office 365, the most popular business emails providers.

The results can be divided into two groups:

1. emails delivery
   (how spf, dkim and dmarc affect the delivery of sent messages)
   Google mail: the emails are always accepted, authentication seems not to be considered at all
   Office 365: is generally responsive to spf and dkim. The only way to get consistent results, reaching the inbox, is to associate them with dmarc
    

2. spoofing protection
   (how spf, dkim and dmarc protect the sender’s email address from being spoofed*)
   * = make the message appear from someone other than the actual source
   Google mail: combining dmarc and spf (fail or softfail qualifiers), the spoofed senders get filtered to the Spam folder or rejected (depending on your dmarc settings)
   Office 365: spf (fail or softfail qualifiers) is enough to send fake senders to the Junk email folder

 
They are summarized as follows:

 
Below there is the full range of tests that have been made.

Notes:

• the from address (visible sender) and the envelope from (return-path) are from the same domain
• “dkim pass”: the dkim signing domain is the same as the one of the from address
• “dkim diff”: the dkim signing domain is different than the one of the from address
• the asterisks in the second group means that the results have not been consistent over time