Sample IMAPtest Tests

Functional Testing

Simple imaptest to cover the basics:

timeout 10s imaptest pass=supersecret host=127.0.0.1 mbox=testmbox.sm40k user=testuser1 Fetch2=100 store=100 delete=100 expunge=100 clients=1

Check the output for errors.

Verify that messages exist in INBOX:

doveadm mailbox status -u testuser1 all INBOX

Copy a message with doveadm:

doveadm copy -u testuser1 Trash mailbox INBOX 1

Copy messages with imaptest:

imaptest pass=supersecret host=127.0.0.1 mbox=testmbox.sm40k user=testuser1 copybox=Trash

Move a message:

doveadm move -u testuser1 Trash mailbox INBOX 1

Performance Testing:

Test rapid delivery of lots of messages via IMAP APPEND (100k test users)

imaptest - user=testuser%d pass=testpass mbox=testmbox append=100,0 logout=0 users=100000 clients=500 msgs=100000 no_pipelining secs=10

Test rapid delivery of lots of messages via LMTP (Useful for Scality CDMI, where an LMTP request takes 2 PUTs and IMAP APPEND takes 3 PUTs)

imaptest profile=imaptest.profile mbox=testmbox secs=10

imaptest.profile:

lmtp_port = 24
lmtp_max_parallel_count = 500 # Set to ~50-60% of total_user_count
total_user_count = 800
rampup_time = 0s

user lmtptest {
  username_format = testuser%n
  count = 100%

  mail_inbox_delivery_interval = 1s
  mail_spam_delivery_interval = 0
  mail_action_delay = 0
  mail_action_repeat_delay = 0
  mail_session_length = 0

  mail_send_interval = 0
  mail_write_duration = 0

  mail_inbox_reply_percentage = 0
  mail_inbox_delete_percentage = 0
  mail_inbox_move_percentage = 0
  mail_inbox_move_filter_percentage = 0
}

client lmtponly {
  count = 100%
}

Load Testing:

1h mixed test against proxy (10.41.1.135) with 2m users and 200 clients:

timeout 1h imaptest pass=testpassword host=10.41.1.135 mbox=testmbox user=testuser%d users=1-2000000 Fetch2=100 store=100 delete=90 expunge=100 clients=200

8hr mixed test with 2m users; generally this would be run against multiple proxies (host=proxy ip) from multiple imaptest nodes.

timeout 8h imaptest pass=testpassword host=127.0.0.1 mbox=testmbox user=testuser%d users=1-2000000 Fetch2=100 store=100 delete=90 expunge=100 clients=100

POP3 + LMTP test with profile

imaptest pass=testpassword mbox=testmbox.sm40k profile=pop3_2m_profile.conf no_tracking clients=10000

pop3_2m_profile.conf

lmtp_port = 24
lmtp_max_parallel_count = 1800
total_user_count = 2000000
rampup_time = 600s

user pop3 {
  username_format = testuser%7n
  username_start_index = 1
  count = 100%

  mail_inbox_delivery_interval = 1h
  mail_spam_delivery_interval = 0
  mail_action_delay = 30s
  mail_action_repeat_delay = 1s
}

client pop3 {
  count = 70%
  connection_max_count = 1
  protocol = pop3
  pop3_keep_mails = no
  login_interval = 1m
}

client pop3 {
  count = 30%
  connection_max_count = 1
  protocol = pop3
  pop3_keep_mails = yes
  login_interval = 5min
}

IMAP + LMTP Test with profile

imaptest pass=testpassword mbox=testmbox profile=imap_4m_profile.conf clients=10000

imap_4m_profile.conf

lmtp_port = 24
lmtp_max_parallel_count = 15000
total_user_count = 4000000
rampup_time = 60s

user imap_poweruser {
  username_format = testuser%7n
  username_start_index = 2000000
  count = 50%

  mail_inbox_delivery_interval = 10m
  mail_spam_delivery_interval = 0s
  mail_action_delay = 1s
  mail_action_repeat_delay = 0
  mail_session_length = 5s

  mail_send_interval = 2h
  mail_write_duration = 2m

  mail_inbox_reply_percentage = 50
  mail_inbox_delete_percentage = 50
  mail_inbox_move_percentage = 35
  mail_inbox_move_filter_percentage = 10
}

user imap_normal {
  username_format = testuser%7n
  username_start_index = 1
  count = 50%

  mail_inbox_delivery_interval = 1h
  mail_spam_delivery_interval = 0
  mail_action_delay = 3 min
  mail_action_repeat_delay = 10s
  mail_session_length = 30s

  mail_send_interval = 3h
  mail_write_duration = 2 min

  mail_inbox_reply_percentage = 5
  mail_inbox_delete_percentage = 80
  mail_inbox_move_percentage = 5
  mail_inbox_move_filter_percentage = 10
}

client Thunderbird {
  count = 60%
  connection_max_count = 1
  imap_idle = yes
  imap_fetch_immediate = UID RFC822.SIZE FLAGS BODY.PEEK[HEADER.FIELDS (From To Cc Bcc Subject Date Message-ID Priority X-Priority References Newsgroups In-Reply-To Content-Type)]
  imap_fetch_manual = RFC822.SIZE BODY[]
  imap_status_interval = 5 min
}

client AppleMail {
  count = 40%
  connection_max_count = 1
  imap_idle = yes
  imap_fetch_immediate = INTERNALDATE UID RFC822.SIZE FLAGS BODY.PEEK[HEADER.FIELDS (date subject from to cc message-id in-reply-to references x-priority x-uniform-type-identifier x-universally-unique-identifier)] MODSEQ
  imap_fetch_manual = BODYSTRUCTURE BODY.PEEK[]
  imap_status_interval = 5 min
}

To generate read load (BODY FETCHs):

imaptest - user=terra.29.%d select=100 fetch2=100,0 logout=0 clients=10 msgs=100000 no_pipelining users=400 no_tracking

To avoid out-of-socket issues when connecting to local HAproxy instance, spread load between multiple local IP addresses to hit HAproxy, e.g.:

obox_fs = scality:http://127.0.%4Hu.1:8080/?timeout_msecs=30000&addhdr=X-Dovecot-Hash:%2Mu/%2.3Mu&bulk_delete=1