Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chatmail update #10

Merged
merged 68 commits into from
Dec 22, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
68 commits
Select commit Hold shift + click to select a range
29eabba
fix links
hpk42 Aug 1, 2024
effd5bc
upgrade debian packages on "cmdeploy run"
hpk42 Aug 1, 2024
dee3663
fix #399
hpk42 Aug 6, 2024
7aa876a
remove dysfunct hispanilandia ref
hpk42 Aug 6, 2024
a1e80fd
Fix ruff warnings
link2xt Aug 23, 2024
cdfce25
add a note on deletion of accounts
hpk42 Sep 2, 2024
e973bc1
organize remotely executing functions in "cmdeploy.remote" sub package
hpk42 Aug 1, 2024
e32d815
use "walrus" operator (didn't know about it, doh!)
hpk42 Aug 13, 2024
8d72d77
don't rename import as link2xt prefers
hpk42 Sep 2, 2024
3ef45c2
add changelog entry for #405
hpk42 Sep 2, 2024
ba811c2
DNS: fix checking for required DNS records (#412)
missytake Sep 13, 2024
a6bdbb7
Set CAA record flags to 0
link2xt Sep 13, 2024
d0ed883
Add IMAP capabilities instead of overwriting them
link2xt Sep 22, 2024
5515607
Setup mtail (#388)
link2xt Oct 14, 2024
46297d4
Document setting up DNAT
link2xt Oct 14, 2024
7573ef9
mention wireguard
link2xt Oct 14, 2024
a2f2e04
fix: set acme_account_url even if some DNS records are not set
link2xt Oct 15, 2024
20fa5d9
Query autoritative nameserver directly to bypass DNS cache
link2xt Oct 15, 2024
737ab54
ci: test `cmdeploy dns` only once
link2xt Oct 15, 2024
15f30d8
cmdeploy: flag to disable postfix + dovecot for migration
missytake Oct 16, 2024
babdff3
docs: more details for the repo overview #419
missytake Oct 15, 2024
80cbdda
docs: mention the chatmail.ini in the cmdeploy description
missytake Oct 15, 2024
bbf508d
docs: nicer linebreaks
missytake Oct 16, 2024
5055434
Fix OpenPGP payload check
link2xt Oct 22, 2024
48fdff6
fix wrong ref in changelog
hpk42 Oct 16, 2024
8fe1734
Dovecot quota_max_mail_size to use the Chatmail max_message_size value
feld Oct 26, 2024
3e646ef
add PR link to CHANGELOG.md
missytake Oct 27, 2024
7f3f69f
fix: increase `request_queue_size` for UNIX sockets to 1000
link2xt Oct 26, 2024
30392df
cmdeploy: add argument to specify different SSH host than mail_domain
missytake Oct 27, 2024
579e6fd
added changelog
missytake Oct 28, 2024
75f11e6
updated privacy policy to testrun UG
missytake Oct 26, 2024
648bf53
Guide on how to migrate chatmail to a new host
missytake Oct 16, 2024
ebed7eb
doc: migration guide should use new --ssh-host command
missytake Oct 27, 2024
70f77a9
doc: fix step 9 -> step 6
missytake Oct 28, 2024
a9779d7
add changelog
missytake Oct 28, 2024
c35c44a
Replace rsync with tar
link2xt Oct 28, 2024
b92d9c8
doc: use ssh+tar to transfer vmail + dkimkeys as well
missytake Oct 29, 2024
5048bde
Deploy iroh relay
link2xt Oct 22, 2024
aae05ac
CI: set necessary DNS records before cmdeploy run, so it doesn't fail
missytake Oct 30, 2024
af17b45
also change privacy policy to circumscribe iroh-relay services
hpk42 Oct 30, 2024
dfc1042
CI: fix #422 nested acme&dkimkeys folders
missytake Oct 30, 2024
3098afb
CI: fix accepting ns.testrun.org SSH Host Key
missytake Oct 30, 2024
a5fd5cf
dovecot: disable anvil authentication penalty
missytake Oct 30, 2024
8ea96e5
dovecot: fix syntax error
missytake Oct 30, 2024
72df078
add support for specifying whole domains for passthrough
hpk42 Sep 6, 2024
d3e71aa
streamline intro, mention IP addresses
hpk42 Oct 30, 2024
99fbe1d
Apply suggestions from code review
hpk42 Oct 30, 2024
fe51dbd
streamline
hpk42 Oct 30, 2024
2c0b659
dns: add iroh CNAME to zonefile
missytake Oct 31, 2024
35a254f
acmetool: only request iroh certificate if it's required
missytake Oct 31, 2024
1221743
cmdeploy: install curl for downloading iroh
missytake Nov 2, 2024
95f8c4b
Update iroh and remove iroh. subdomain
link2xt Nov 5, 2024
b268efb
DNS: fix _mta-sts TXT record on initial setup
missytake Dec 17, 2024
46f6a07
Revert "DNS: fix _mta-sts TXT record on initial setup"
missytake Dec 17, 2024
69fe5ea
DNS: more elegant solution to fix mta-sts record
missytake Dec 17, 2024
8e5174a
DNS: add -all to cmdeploy dns
missytake Dec 17, 2024
08c88ca
CI: test all DNS records
missytake Dec 17, 2024
97c31e3
fix tests
missytake Dec 17, 2024
a2fbb5d
add changelog
missytake Dec 17, 2024
88a8dc9
DNS: recommend cmdeploy dns --all in the README
missytake Dec 17, 2024
d11038b
DNS: out() instead of print()
missytake Dec 19, 2024
a7b808e
Release 1.5.0
missytake Dec 20, 2024
5c78619
DNS: make --all non-optional for cmdeploy dns
missytake Dec 20, 2024
6a32192
Revert rest of #462
missytake Dec 20, 2024
d6205d9
add changelog
missytake Dec 20, 2024
5b8de76
fix tests
missytake Dec 20, 2024
df44aa5
Merge branch 'Chatmail-Update' into main
Gh0stz0x Dec 22, 2024
484ddf6
Merge pull request #8 from roughnecks/main
Gh0stz0x Dec 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/staging-ipv4.testrun.org-default.zone
Original file line number Diff line number Diff line change
Expand Up @@ -17,4 +17,5 @@ $TTL 300
;; DNS records.
@ IN A 37.27.95.249
mta-sts.staging-ipv4.testrun.org. CNAME staging-ipv4.testrun.org.
iroh.staging-ipv4.testrun.org. CNAME staging-ipv4.testrun.org.
www.staging-ipv4.testrun.org. CNAME staging-ipv4.testrun.org.
1 change: 1 addition & 0 deletions .github/workflows/staging.testrun.org-default.zone
Original file line number Diff line number Diff line change
Expand Up @@ -17,5 +17,6 @@ $TTL 300
;; DNS records.
@ IN A 37.27.24.139
mta-sts.staging2.testrun.org. CNAME staging2.testrun.org.
iroh.staging2.testrun.org. CNAME staging2.testrun.org.
www.staging2.testrun.org. CNAME staging2.testrun.org.

10 changes: 6 additions & 4 deletions .github/workflows/test-and-deploy-ipv4only.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,9 @@ jobs:
if [ -f dkimkeys-ipv4/dkimkeys/opendkim.private ]; then rsync -avz -e "ssh -o StrictHostKeyChecking=accept-new" dkimkeys-ipv4 [email protected]:/tmp/ || true; fi
if [ "$(ls -A acme-ipv4/acme/certs)" ]; then rsync -avz -e "ssh -o StrictHostKeyChecking=accept-new" acme-ipv4 [email protected]:/tmp/ || true; fi
# make sure CAA record isn't set
scp .github/workflows/staging-ipv4.testrun.org-default.zone [email protected]:/etc/nsd/staging-ipv4.testrun.org.zone
ssh -o StrictHostKeyChecking=accept-new [email protected] sed -i '/CAA/d' /etc/nsd/staging-ipv4.testrun.org.zone
ssh [email protected] nsd-checkzone staging-ipv4.testrun.org /etc/nsd/staging-ipv4.testrun.org.zone
ssh [email protected] systemctl reload nsd

- name: rebuild staging-ipv4.testrun.org to have a clean VPS
Expand All @@ -64,8 +66,8 @@ jobs:
rsync -e "ssh -o StrictHostKeyChecking=accept-new" -avz [email protected]:/tmp/acme-ipv4 acme-restore || true
rsync -avz [email protected]:/tmp/dkimkeys-ipv4 dkimkeys-restore || true
# restore acme & dkim state to staging2.testrun.org
rsync -avz acme-restore/acme-ipv4/acme [email protected]:/var/lib/acme || true
rsync -avz dkimkeys-restore/dkimkeys-ipv4/dkimkeys [email protected]:/etc/dkimkeys || true
rsync -avz acme-restore/acme-ipv4/acme [email protected]:/var/lib/ || true
rsync -avz dkimkeys-restore/dkimkeys-ipv4/dkimkeys [email protected]:/etc/ || true
ssh -o StrictHostKeyChecking=accept-new -v [email protected] chown root:root -R /var/lib/acme || true

- name: run formatting checks
Expand Down Expand Up @@ -93,6 +95,6 @@ jobs:
- name: cmdeploy test
run: CHATMAIL_DOMAIN2=nine.testrun.org cmdeploy test --slow

- name: cmdeploy dns (try 3 times)
run: cmdeploy dns || cmdeploy dns || cmdeploy dns
- name: cmdeploy dns
run: cmdeploy dns -v

12 changes: 7 additions & 5 deletions .github/workflows/test-and-deploy.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,9 @@ jobs:
if [ -f dkimkeys/opendkim.private ]; then rsync -avz -e "ssh -o StrictHostKeyChecking=accept-new" dkimkeys [email protected]:/tmp/ || true; fi
if [ "$(ls -A acme/certs)" ]; then rsync -avz -e "ssh -o StrictHostKeyChecking=accept-new" acme [email protected]:/tmp/ || true; fi
# make sure CAA record isn't set
ssh -o StrictHostKeyChecking=accept-new [email protected] sed -i '/CAA/d' /etc/nsd/staging2.testrun.org.zone
scp -o StrictHostKeyChecking=accept-new .github/workflows/staging.testrun.org-default.zone [email protected]:/etc/nsd/staging2.testrun.org.zone
ssh [email protected] sed -i '/CAA/d' /etc/nsd/staging2.testrun.org.zone
ssh [email protected] nsd-checkzone staging2.testrun.org /etc/nsd/staging2.testrun.org.zone
ssh [email protected] systemctl reload nsd

- name: rebuild staging2.testrun.org to have a clean VPS
Expand All @@ -64,8 +66,8 @@ jobs:
rsync -e "ssh -o StrictHostKeyChecking=accept-new" -avz [email protected]:/tmp/acme acme-restore || true
rsync -avz [email protected]:/tmp/dkimkeys dkimkeys-restore || true
# restore acme & dkim state to staging2.testrun.org
rsync -avz acme-restore/acme/ [email protected]:/var/lib/acme || true
rsync -avz dkimkeys-restore/dkimkeys/ [email protected]:/etc/dkimkeys || true
rsync -avz acme-restore/acme [email protected]:/var/lib/ || true
rsync -avz dkimkeys-restore/dkimkeys [email protected]:/etc/ || true
ssh -o StrictHostKeyChecking=accept-new -v [email protected] chown root:root -R /var/lib/acme || true

- name: run formatting checks
Expand All @@ -91,6 +93,6 @@ jobs:
- name: cmdeploy test
run: CHATMAIL_DOMAIN2=nine.testrun.org cmdeploy test --slow

- name: cmdeploy dns (try 3 times)
run: cmdeploy dns -v || cmdeploy dns -v || cmdeploy dns -v
- name: cmdeploy dns
run: cmdeploy dns -v

78 changes: 76 additions & 2 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,87 @@

## untagged

## 1.5.0 2024-12-20

- cmdeploy dns: always show recommended DNS records
([#463](https://github.com/deltachat/chatmail/pull/463))

- add `--all` to `cmdeploy dns`
([#462](https://github.com/deltachat/chatmail/pull/462))

- fix `_mta-sts` TXT DNS record
([#461](https://github.com/deltachat/chatmail/pull/461)

- deploy `iroh-relay` and also update "realtime relay services" in privacy policy.
([#434](https://github.com/deltachat/chatmail/pull/434))
([#451](https://github.com/deltachat/chatmail/pull/451))

- add guide to migrate chatmail to a new server
([#429](https://github.com/deltachat/chatmail/pull/429))

- disable anvil authentication penalty
([#414](https://github.com/deltachat/chatmail/pull/444)

- increase `request_queue_size` for UNIX sockets to 1000.
([#437](https://github.com/deltachat/chatmail/pull/437))

- add argument to `cmdeploy run` for specifying
a different SSH host than `mail_domain`
([#439](https://github.com/deltachat/chatmail/pull/439))

- query autoritative nameserver to bypass DNS cache
([#424](https://github.com/deltachat/chatmail/pull/424))

- add mtail support (new optional `mtail_address` ini value)
This defines the address on which [`mtail`](https://google.github.io/mtail/)
exposes its metrics collected from the logs.
If you want to collect the metrics with Prometheus,
setup a private network (e.g. WireGuard interface)
and assign an IP address from this network to the host.
If you do not plan to collect metrics,
keep this setting unset.
([#388](https://github.com/deltachat/chatmail/pull/388))

- fix checking for required DNS records
([#412](https://github.com/deltachat/chatmail/pull/412))

- add support for specifying whole domains for recipient passthrough list
([#408](https://github.com/deltachat/chatmail/pull/408))

- add a paragraph about "account deletion" to info page
([#405](https://github.com/deltachat/chatmail/pull/405))

- avoid nginx listening on ipv6 if v6 is dsiabled
([#402](https://github.com/deltachat/chatmail/pull/402))

- refactor ssh-based execution to allow organizing remote functions in
modules.
([#396](https://github.com/deltachat/chatmail/pull/396))

- trigger "apt upgrade" during "cmdeploy run"
([#398](https://github.com/deltachat/chatmail/pull/398))

- drop hispanilandia passthrough address
([#401](https://github.com/deltachat/chatmail/pull/401))

- set CAA record flags to 0

- add IMAP capabilities instead of overwriting them
([#413](https://github.com/deltachat/chatmail/pull/413))

- fix OpenPGP payload check
([#435](https://github.com/deltachat/chatmail/pull/435))

- fix Dovecot quota_max_mail_size to use max_message_size config value
([#438](https://github.com/deltachat/chatmail/pull/438))


## 1.4.1 2024-07-31

- fix metadata dictproxy which would confuse transactions
resulting in missed notifications and other issues.
([#393](https://github.com/deltachat/chatmail/pull/388))
([#394](https://github.com/deltachat/chatmail/pull/389))
([#393](https://github.com/deltachat/chatmail/pull/393))
([#394](https://github.com/deltachat/chatmail/pull/394))

- add optional "imap_rawlog" config option. If true,
.in/.out files are created in user home dirs
Expand Down
Loading
Loading