Skip to content

"Elf-Disclosure" for September 2023

We've been in prod for 2 months now, and September was mostly spent on bugfixes and strategic improvements, which I'll detail below, although we did bring Miniflux, Joplin , and Tdarr into the fold!

Here are some shiny stats for September 2023, followed by a summary of some of the bigger changes announced this month in the blog...

Stats

Focus Jul 2023 Aug 2023 September 2023
Cluster $428 $428 $428
Store $223 $100 $100
CI $200 $600 $100
Cloud $20 $20 $20
Development 124h / $18,600 60h / $12,000 2 15h / $2,250
Total Expenses $19,471 $13,148 $2,923
Income $43 $215 $95
% of expenses 0.2% 1.63% 4.1%
Focus July 2023 Aug 2023 September 2023
Subscribers 48 53 43 1
Ingress 19.5TB 23TB 34TB
Egress 3.3TB 7TB 14TB
Pods 619 792 430 2
Focus June 2023 June 2023 September 2023
Total invested thus far 4 $42,669 $53,118 $56,111
Total revenue $43 $258 $353
Income % of total invested 0% 0.1% 0.5%

Resources

Most apps consume almost no CPU while idle - the larger consumers are streamers doing transcoding, and download clients doing download/unpack operations.

Average CPU utilization (although increased from 2% to 3%) is largely unchanged from last month. Much of this is likely due to removal of deprovisioned / abandoned accounts.

CPU stats for September 2023

Last month (Aug 2023)'s for comparison:

CPU stats for Aug 2023

This graph represents memory usage across the entire cluster. By far the largest consumers of RAM is rook-ceph. Like CPU utilization, there appears to be no month-on-month growth this month, but this data was recorded after deprovisioned accounts were pruned, so it's likely that actual used RAM has increased.

Memory stats for September 2023

Last month (Aug 2023)'s for comparison:

Memory stats for Aug 2023

I'm not sure these stats are accurate, they've likely overly high because pods on the host network (like metallb, ceph, etc) will end up counting all traffic on each host, rather than the pod itself. This is an outstanding issue to fix!

Combined with the ingress/egress graphs on the next page, and the almost doubling of Ceph storage usage, the graphs below indicate more regular network usage compared to the previous month.

Memory stats for September 2023

Last month (Aug 2023)'s for comparison:

Memory stats for Aug 2023

These are the traffic stats for egress from Hetzner. They exclude any traffic to/from Hetzner Storageboxes.

Network traffic increased ~50% from the previous period, and notably egress traffic increased 100%.

Hetzner traffic stats for September 2023

Last month (Aug 2023)'s for comparison:

Hetzner traffic stats for Aug 2023

Ceph provides our own storage ("[ElfStorage][elfstorage]"), typically used for long-term slow storage and seeding. The warning status for this month is due to 1 clients failing to respond to cache pressure, which may be due to torrent clients running directly against ElfStorage (more investigation required, but note the increase in point-in-time IOPS and client throughput)

Ceph stats for September 2023

Last month (Aug 2023)'s for comparison:

Ceph stats for Aug 2023

What's new?

Custom domains

We can now offer custom domains for your ElfHosted services, so that instead of (for example) https://funkypenguin-uptime-kuma.elfhosted.com, you might prefer something like https://status.funkypenguin.co.nz (see how it works?)

More details in this blog post.

Plex over VPN

Plex recently sent notices to users hosted on Hetzner IP ranges, indicating that from 12 Oct 2023, their hosting provider will be blocked.

We don't know exactly what'll happen from 12 Oct, but to mitigate this risk, we now offer Plex with BYOVPN support, so you can plug your existing VPN provider credentials into Plex (like we do with torrent clients), and have Plex "phone home" over the VPN, hopefully avoiding the Hetzner IP block.

More details in this blog post.

Tdarr

Tdarr is a new app introduced this month, which will allow you to batch-transcode your media library for better compatibility with your devices, or for more efficient storage.

More details in this blog post.

Joplin

A user-requested app, Joplin Server is the open-source version of the sync engine behind https://joplincloud.com, which takes you beyond simple apps, by enabling cross-device sync, sharing, publishing, etc.

Screenshot of Joplin

More details in this blog post.

Miniflux

Finally, my favorite minimal RSS client is now an ElfHosted app (and a good candidate for a custom domain).

Screenshot of Miniflux

More details in this blog post.

Join us!

Want to get involved?

Want to get involved? Join us in Discord and come and test-in-production!


  1. Much of this is yearly fees for Wordpress plugins 

  2. Yes, that's a lot! This is the opportunity cost, over a month, of focusing on ElfHosted rather than billable consulting work! 

  3. Total spend includes yearly payments for Wordpress plugins, etc 

  4. All moneyz are in US dollarz! 

  5. In Sept 2023, I changed the way these are counted, prefering users with active subscriptions rather than simply counting users provisioned (also, deprovisioning was improved

  6. After inactive / abandoned accounts were deprovisioned