LEdoian's Blog

Only NAT packets you can deliver responses for

2024-05-08T13:32:00+02:00

When setting up a masquerading nat, it is worth considering masquerading only packets from known networks. That is, instead of rule like iifname eth-inside masquerade use something like iifname eth-inside ip saddr 198.51.100.0/24 masquerade.

I learned the hard way: my laptop in a masqueraded network picked a wrong source address from a subnet the router had no knowledge about. The outbound packets passed through right, but the responses came in, undergone translation, and since the destination was unknown to the router, it used the default route, sending the packet back to the ISP.

The result: IDS triggered by many packets from my router with source IP addresses from all around the Internet, all with destination to my private address. (The ISP was not happy about that.)

Creating own XKB tweaks

2024-04-17T16:40:00+02:00

Debugging this took me a bit too long, so I want to write about the caveat.

My problem: My laptop does not have PageUp and PageDown keys, and many other keyboards I use have similar deficiencies. And I use various environments and various systems, some of which are shared with other people who don't need/want my tweaks. IOW: I want something generic, but it must be confined to my user – no system-wide daemon, no udev remapping. (I mostly ended up with these solutions when I searched for a way to remap keys on Wayland.)

Requirements: xkbcommon implementation of XKB with utilities. It is quite common these days (duh…), but you could probably just compile this yourself if you don't have it.

The tweaking

The xkbcommon guide tells us that we can inspect the files in [1] /usr/share/X11/xkb for the source files and just write our bits to ~/.config/xkb/symbols/ledoian. In particular, I added this snippet to remap keyboard brightness controls to PageUp/Down:

partial
xkb_symbols "qs" {
    key <I238> {[ Prior ]};
    key <I237> {[ Next ]};
};

The key identifiers are taken e.g. from xkbcli interactive-wayland. However, this is KcCGST [2] description, but layouts are configured using RMLVO, so I need to define an option and tell what it should do. The guide wants me to create ~/.config/xkb/rules/evdev with:

! option = symbols
  ledoian:qs    = +ledoian(qs)
! include %S/evdev

Now I just add ledoian:qs [3] to my keyboard configuration and… it does not work. For this, at all, but if I remap e.g. the L key, that gets applied. The problem? That included file says that the default keyboard model always includes inet(evdev) symbols. Those symbols set the default meaning of the keys, but since that got applied later, it overrides my tweak.

Solution: first include, then add my option.

How to debug: read stuff that xkbcli compile-keymap --verbose tells you (pass your config as --layout, --variant, --options, …). At the top it says what it does:

xkbcommon: DEBUG: Include path added: /home/ledoian/.config/xkb
xkbcommon: DEBUG: Include path added: /usr/share/X11/xkb
xkbcommon: DEBUG: Compiling from RMLVO: rules 'evdev', model 'pc105', layout 'us', variant '(null)', options '(null)'
xkbcommon: DEBUG: Compiling from KcCGST: keycodes 'evdev+aliases(qwerty)', types 'complete', compat 'complete', symbols 'pc+us+inet(evdev)'

My option would appear before the inet(evdev) part.

A note about X11

X11 uses a separate implementation of XKB (the original one, in fact), which does _not_ look into the user directory, just the system ones. However, you can compile the keymap yourself using xkbcli compile-keymap [KEYMAP OPTIONS] > my_layout.xkb and load it into the X server with xkbcomp my_layout.xkb $DISPLAY.

[1]	This is not technically accurate, really the paths reference `$XDG_something` variables. I am lazy and just copied my system, so YMMV (probably won't, though).

[2] There are two levels of describing the keymap: the lowlevel one is called KcCGST (short for keycodes, compat, geometry, symbols, types) and is considered to be an implementation detail; the user-facing one is RMLVO (rules, model, layout, variant, options) and that is what you use in the configs, with setxkbmap &c.

[3] While both this example and the upstream layouts name the symbols and options similarly, I think they don't need to be related – you should be able to put whatever you want in your options to the left of =, the right hand side is the name of the symbol file and if a non-default layout from that file is used, its name is put in the parentheses.

You sure you want to hear the gossip?

2024-03-11T22:49:00+01:00

Sometimes, not knowing something about your friends is simpler than knowing something you know you aren't supposed to know…

TL;DR: If you are gossiping, please handle information which change attitude towards others with care and maybe share them with consent of the listener. [1]

Some time ago, I was casually talking with my friend, let's call them Alex. For one reason or another, we got to gossip and I learnt a new, very private information about our mutual friend, Bay. [2] I knew Bay would not expect me to know or possibly even want me to know at that time, yet the new part of their identity would require me to behave differently around Bay in order not to hurt them. [3]

That turned my interactions with Bay into a bit of a minefield:

If I behaved according to what I learnt, I may easily overstep Bay's boundaries and invade their privacy, possibly quite badly. [4]
If I kept my old behaviour, I would feel like I am actively hurting Bay.
If I accidentally slipped my tongue in front of Bay and they notice, I still ending up invading their privacy as in point 1.
I am also prone to sharing the gossip, maybe accidentally. I would be to someone else what Alex was to me, and I certainly didn't want to cast this "curse" on anyone. [5]
If Bay subconsciously noticed I am behaving in line with their secret and in another interaction I wouldn't, they could feel invalidated (without an obvious reason why).

It sucks, it made talking to Bay needlessly stressful. Please don't do that.

So, to reiterate the message: Please gossip *safely* and *consensually* about stuff that is private in nature and would change attitudes towards people. For the queer stuff, this can be rephrased in layman's terms as please just don't out other people to people who do not explicitly want to know. [6]

(Again, maybe gossip safely anyway, but for the "regular" gossip you can usually hide what you know without feeling that bad.)

Final remarks

I wrote this post mainly to raise awareness and help learn from past mistakes. It is not meant to shame Alex for telling me, they might not have been aware and neither were I at the time.

Apart from the role as "me" in the story, I also were "Bay" a few times, luckily not with a too intimate part of my identity. And while I try not to be another "Alex", I cannot rule that completely out unfortunately.

This post has been a long time in my backlog (~6 months maybe), it is not a reaction to any recent gossip I have heard. (The points I make still hold ofc, but lately I only heard "the ordinary stuff" which I will probably just forget and not care about without harming anyone.)

Lastly, Bay eventually told me themself, so my life is peaceful again. I didn't ask if I am allowed to talk about that and with whom, so I err on the safe side and will not write here anything else :-)

[1]	I mean, gossiping is not nice to the mentioned person who doesn't usually consent, but it's not like I could prevent people from gossiping, so this post is not about that. Also, you can conceal your knowledge of "regular" gossip more easily than of gossip which changes your attitude.

[2]

I originally wanted to have the friends be Alice and Bob, but that might support the narative that "girls gossip", which is sexist and IME not accurate (more like "everyone gossips"). So I made my friends be of ambiguous gender and use they/them pronouns. Sorry, this might make the post a bit harder to read, but the stereotypes need to die :-)

[3]

I will not give any more information here. Don't try to guess, I am not telling. Bay is my friend and deserves privacy. (However, if you suspect that you might be the Bay of this story, by all means ask me whether you are. I don't want you to feel bad / insecure / unsure / … (And in fact, there may be multiple Bays…))

[4]

There are definitely parts of my identity I do not share much and would probably get upset at various people (and also paranoid) if I got outed. OTOH, the number of people who know my secrets is non-decreasing anyway, so I try to prepare that someone unexpected inevitably will overstep this boundary, possibly in a good faith. (If you want to try to act upon my secrets, I'd appreciate you asking beforehand to avoid weird reactions.)

[5]	Naturally, this gossip sharing can have various circumstances: Me (or Alex) being unaware that the listener (call them Cameron) doesn't know, slipping my tongue in a subtle way yet Cameron understanding the subtext, being drunk, … It might be difficult to keep the secret in all those situations.

Print your stuff on Möbius bands!

2024-03-02T18:07:00+01:00

I found a fun and useful way of printing stuff to ~~both~~all sides of a paper. I just need to find the right printer!

Quick recap: how to conventionally print stuff two-sided

A typical way is just sending the page to get printed two-sided (with setting the correct way of flipping pages). That is, on the other side of page 1 is page 2, next sheet contains pages 3,4, then 5 & 6, …

This is usually trivial to print on duplex printers, a bit hard to simulate on one-sided printers (but some drivers can do that) and has drawbacks when you need to look at stuff on other pages at the same time – you need to flip the sheet often, as you only can put half of the pairs of pages next to each other (even one and the following odd one).

Ordinary two-sided printing. Red arrows show sheet flips between consecutive pages.

A slight improvement hack is putting two pages on the same side of the paper (works well with A-series of papers, I don't know for Letters &co.) – you can put up to four pages of the original document next to each other, if they are the right ones, but there are still pairs of pages that need turning sheets. Also only works if the original pages do not have too tiny features on them. [1]

Booklets are fun and approachable, but still suffer from the same issues as the conventional duplex print. They might be a bit hard to print, but programs like pdfbook or paperjam make it easy to prepare for the classic duplex printing. Also, it is maybe hard to tell which page ends up where, as the order is: last+first, second+penultimate, third-from-end+third, … until the pages meet in the middle.

The most common booklet order with two pages per side for landscape orientation. (Note that we show more pages, and thus more sheet-flips; the number of sheet-flips is in fact the same as for two-sided printing.)

The improvement for seeing multiple consecutive pages

In order to be able to look simultaneously at many consecutive pages of the original, I think the order of first+first-past-half, second+second-past-half, … middle+last is much better (or maybe even the best). Since consecutive pages end up on different sheets (whenever there are at least three pages), if the original has e.g. figures on different page or long code listing, you can see it all!

The "Möbius order" of pages.

And this is really easy to use: You read a page and when you don't need it anymore, you flip it and put to the end of the page stack [2]. If you need to look at several pages, just rotate them in the same order as they go the first time. [3]

Need to print this? For one-sided printers this is rather easy, too: just print the first half (the bigger one) on the sheets, then put them back into the tray and print the rest on them. You might need to experiment which side the sheets should be put in and whether you need to print the rest in reverse order, but that is it.

Got the pages shuffled? Sort them by the first half, as if the print was one-sided.

The only annoying thing for me is that there is not much software that could reorder the pages for two-sided printing, so that you don't need to re-insert the sheets back in the tray. So I patched paperjam to enable this. [4]

And the best part? If you would try to glue consecutive pages side-to-side, you'd end up with a Möbius band! So if you get a Möbius paper, you can just print this one-sided (duh :-D)

Honorable mention: leporello

Printing leporellos (aka concertina folded) also has many of the same benefits, since there is only one pair of consecutive pages that need a page flip. The order is first+last, second+penultimate, … and the original pages can be shuffled this way with paperjam or simply using the other order for the second side printing, than for the Möbius band. But there is a bit of fun topology missing here :-)

A leporello order is also quite good, with only one sheet-flip in the entire document.

Is this the best order?

Yes, if "best" means "the minimum difference of numbers of pages that get put on the same sheet is as big as possible". The proof is left as an exercise for the reader.

Of course, this holds for a set of pages with no additional assumptions. In ordinary print, having a sheet-turn between chapters is fine and under similar guarantees other approaches may yield better results.

Cheat sheet: paperjam commands

Various commands for ordering pages for duplex printing with paperjam.
Order	Command
Classic two-sided	`null`
Two pages per side	`nup(2)`
Booklet	`book` (follow with `nup(2)` for actual booklet print)
Leporello	`modulo(2) {1 2} modulo(1,half) {1 -1}` (The first `modulo` just adds blank pages to the end.)
Möbius (with patch)	`interleave(2)`
Möbius (known page count)	`select {1..5 10..6} modulo(1,half) {1 -1}`
Multiple Möbius bands, odd-even	`modulo(4) {1 3 2 4}`
Multiple bands, "modulo 3"	`modulo(6) {1 4 2 5 3 6}`
Second half (smaller) of pages in reverse order	`modulo(1,half) {-1}`
Second half (smaller) of pages in normal order	`modulo(1,half) {-1} modulo(1) {-1}`
First half (bigger) of pages	`modulo(2) {1 2} modulo(1,half) {1}`

I might create more patches for avoiding the weird modulo commands…

[1]

Most of the figures in this article are drawn with a single page per a side of a sheet. I consider putting more pages on a single side of paper to be an implementation detail, because it is not always possible (e.g. with too small font) and sometimes you could put more than two pages on a single side of paper, which leads to the fact that if you put everything on one side of the paper, you can see everything at once and save the other side. Not very useful though… My only exception is the booklet printing below, because that one seems to be rather common.

[2]	See how this neatly puts the first-past-half page right after the half of the stack? Awesome!

[3]	Also, if you flip the page around the wrong edge, you can just rotate the rest of the stack and end up with the correct orientation.

[4] A slight variation for which I can generate the order with upstream paperjam is using this order on small subsets of pages. For example, if you only want to be able to see any two consecutive pages, you can do this for just four pages – the order is then 1+3, 2+4, 5+7, 6+8,… Since each sheet either contains two odd or two even pages, the following page is on different sheet than the previous one. And you can do this "modulo 3" to see three pages: 1+4, 2+5, 3+6, 7+10, … This "simulates" multiple smaller Möbius bands, but will be probably harder to use.

How to convert CBZ to PDF

2024-02-17T16:55:00+01:00

Extract the archive (cbz is just a zip, cbr is a rar, …)
Convert individual pictures to PDF using img2pdf
- Many other ways including convert from ImageMagick tend to do weird stuff like breaking aspect ratios or adding margins
Merge files into the single PDF, e.g. using qpdf --empty --pages *.pdf -- output.pdf.

References

Why

My eBook reader (PocketBook Touch Lux) does not seem to be able to handle cbz.

Do not forget about IPv6 DNS

2024-01-24T03:20:00+01:00

Do you think IPv6-only internet works OK? I am going to tell you that it does not, but it is not immediately visible. TL;DR: The internet can be broken also by forgetting to add AAAA records of the nameservers. This creates IPv4 requirement for the resolving even when the target is reachable using IPv6.

Quick recap

Connecting to a website is easy, right? You type in the name, you get the front page.

This is a very naïve idea of connecting to a server.

OK, it is a bit harder: the computer needs an IP address, so we need to use this magic box called DNS. The flow looks something like this:

Slightly better, now we at least know the machine-readable address.

And for IPv6-only everything on the picture has to have IPv6 connectivity and AAAA DNS records.

Reaching IPv4 land from IPv6-only

There are few^H^H^Hmany sites that still only support IPv4. To reach them, we need someone who can reach both the IPv4- and IPv6-land to go there on our behalf – a proxy. This proxy can be ad-hoc (I often use ssh -D) or there are well-known protocols like NAT64 with DNS64 to do that in a standard and lightweight manner. [1] In that case, the connection looks like this:

And now we can reach the whole internet.

You might already know that you need some workaround like this to reach GitHub. What I think you might not know, you need similar workaround to reach the Wikipedia.

Disclaimer: I like Wikipedia and this is not meant to shame them, just use as an example. I am aware of several other sites suffering from the same problem, including at least one IPv6 test. [2] (It would be nice if they added the missing piece in the puzzle, though.)

Enter DNS

Our picture has one unexplored magic box: the DNS. As per the definition (which I just made up and was not bothered to even fully formulate):

yada yada distributed database of records attached to the strings – domain names. The records hold various information about the domain depending on the type.

There are three interesting types of records: A records give IPv4 addresses, AAAA give IPv6 addresses and NS give names of servers who know about the particular subtree of the database. And to actually resolve the final AAAA record the (recursive) resolver starts at the root zone and tries to find the answer. [3] The resolution algorithm can be visualised like this:

Yeah, it's a mess.

There is one extra tricky bit: the NS records contain names, not addresses, so when resolving we need two queries for each layer (very simplified): first we ask for the final domain (blog.ledoian.cz) and get a NS record (when the server does not have the answer) and then we need to ask for the A or AAAA record of the name from that record, so that we can connect to the server mentioned in the NS record. (This allows a nameserver to be made redundant and/or reside on other types of network.)

You might start to see the issue. When the DNS was just a black box, we could paint the whole picture green and call it a day. And from the regular user's point of view, that is the case, just use some public DNS like 1.1.1.1, 8.8.8.8 or 9.9.9.9. Oh, right, I meant these easy-to-remember addresses: 2606:4700:4700::1111, 2001:4860:4860::8888 and 2620:fe::fe, respectively. The point is, they will give you the answer because they are dual-stack, not IPv6-only.

In a way, those servers (or other dual-stack resolvers) act like another proxy, similar to the SSH, NAT64 and NAT44 ones mentioned earlier. This may not be much of a problem for many people. But if you have any reason to use your own recursive DNS server (privacy reasons, DNSSEC validation, ISP provides bad service, you are the ISP, …) inside an IPv6-only network, you will have issues. [4]

Example: Wikipedia

Let's now see this in action. You know Wikipedia, right? And you can reach Wikipedia on IPv6, right? It has an AAAA record (don't mind the CNAME, that means that the server is really called some other way):

$ dig en.wikipedia.org AAAA
[…]
en.wikipedia.org.   18737   IN      CNAME   dyna.wikimedia.org.
dyna.wikimedia.org. 323     IN      AAAA    2a02:ec80:600:ed1a::1

And this record does work:

$ ncat --ssl 2a02:ec80:600:ed1a::1 443 <<GO
GET /wiki/Main_Page HTTP/1.1
Host: en.wikipedia.org

GO
HTTP/1.1 200 OK
[…]
content-language: en
content-type: text/html; charset=UTF-8
content-length: 98078

<!DOCTYPE html>
[…]

But we can dig deeper: let's see what servers we are really asking:

$ dig en.wikipedia.org AAAA +trace

; <<>> DiG … <<>> en.wikipedia.org AAAA +trace
;; global options: +cmd
.                   78918   IN      NS      e.root-servers.net.
.                   78918   IN      NS      f.root-servers.net.
.                   78918   IN      NS      g.root-servers.net.
.                   78918   IN      NS      h.root-servers.net.
.                   78918   IN      NS      i.root-servers.net.
.                   78918   IN      NS      j.root-servers.net.
.                   78918   IN      NS      k.root-servers.net.
.                   78918   IN      NS      l.root-servers.net.
.                   78918   IN      NS      m.root-servers.net.
.                   78918   IN      NS      a.root-servers.net.
.                   78918   IN      NS      b.root-servers.net.
.                   78918   IN      NS      c.root-servers.net.
.                   78918   IN      NS      d.root-servers.net.
;; Received 525 bytes from … in 0 ms

org.                        172800  IN      NS      c0.org.afilias-nst.info.
org.                        172800  IN      NS      a2.org.afilias-nst.info.
org.                        172800  IN      NS      a0.org.afilias-nst.info.
org.                        172800  IN      NS      b0.org.afilias-nst.org.
org.                        172800  IN      NS      b2.org.afilias-nst.org.
org.                        172800  IN      NS      d0.org.afilias-nst.org.
;; Received 788 bytes from 202.12.27.33#53(m.root-servers.net) in 24 ms

wikipedia.org.              3600    IN      NS      ns0.wikimedia.org.
wikipedia.org.              3600    IN      NS      ns1.wikimedia.org.
wikipedia.org.              3600    IN      NS      ns2.wikimedia.org.
;; Received 658 bytes from 2001:500:48::1#53(b2.org.afilias-nst.org) in 20 ms

en.wikipedia.org.   86400   IN      CNAME   dyna.wikimedia.org.
;; Received 94 bytes from 208.80.153.231#53(ns1.wikimedia.org) in 132 ms

Hey, there are IPv4 addresses in there! I know, this is cheating, the output is from a dual-stack machine. But we can still simulate IPv6-only resolution by adding -6 flag:

$ dig en.wikipedia.org AAAA +trace -6

; <<>> DiG … <<>> en.wikipedia.org AAAA +trace -6
;; global options: +cmd
.                   78915   IN      NS      d.root-servers.net.
.                   78915   IN      NS      e.root-servers.net.
.                   78915   IN      NS      f.root-servers.net.
.                   78915   IN      NS      g.root-servers.net.
.                   78915   IN      NS      h.root-servers.net.
.                   78915   IN      NS      i.root-servers.net.
.                   78915   IN      NS      j.root-servers.net.
.                   78915   IN      NS      k.root-servers.net.
.                   78915   IN      NS      l.root-servers.net.
.                   78915   IN      NS      m.root-servers.net.
.                   78915   IN      NS      a.root-servers.net.
.                   78915   IN      NS      b.root-servers.net.
.                   78915   IN      NS      c.root-servers.net.
;; Received 525 bytes from … in 0 ms

org.                        172800  IN      NS      d0.org.afilias-nst.org.
org.                        172800  IN      NS      c0.org.afilias-nst.info.
org.                        172800  IN      NS      b2.org.afilias-nst.org.
org.                        172800  IN      NS      a0.org.afilias-nst.info.
org.                        172800  IN      NS      b0.org.afilias-nst.org.
org.                        172800  IN      NS      a2.org.afilias-nst.info.
;; Received 816 bytes from 2001:500:2::c#53(c.root-servers.net) in 8 ms

wikipedia.org.              3600    IN      NS      ns0.wikimedia.org.
wikipedia.org.              3600    IN      NS      ns1.wikimedia.org.
wikipedia.org.              3600    IN      NS      ns2.wikimedia.org.
couldn't get address for 'ns0.wikimedia.org': not found
couldn't get address for 'ns1.wikimedia.org': not found
couldn't get address for 'ns2.wikimedia.org': not found
dig: couldn't get address for 'ns0.wikimedia.org': no more

Some of those IPv4 addresses were benign – the respective servers are reachable both using IPv4 and IPv6 address or there is an alternative server that is reachable using IPv6. That is the case for the root nameserver – in the second case, we used C, which has IPv6 address (2001:500:2::c). In fact, the M server also has IPv6 address, but dig chose the IPv4 one (it should not matter):

$ dig m.root-servers.net AAAA
[…]
m.root-servers.net. 77991   IN      AAAA    2001:dc3::35

But the latter case is the bigger issue. For the domain wikipedia.org there are three nameservers:

$ dig wikipedia.org NS -6
[…]
wikipedia.org.              86400   IN      NS      ns0.wikimedia.org.
wikipedia.org.              86400   IN      NS      ns1.wikimedia.org.
wikipedia.org.              86400   IN      NS      ns2.wikimedia.org.

This is the last answer that we could get on an IPv6-only network, because none of these three servers has AAAA record (some of them may have IPv6 address unknown to us):

$ dig ns0.wikimedia.org AAAA
[…]
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 59468
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 1

The NOERROR status says the domain name exists, but we got zero answers for AAAA records. This is the case for all three nameservers. And here is the ultimate picture of what is happening and what goes wrong.

The breakage in action

Also note that the connection from the laptop to the DNS resolver may in fact consist of a chain of several (caching, non-recursive) DNS resolvers, so that the final DNS resolver can have dual-stack connectivity.

The problems with this state

So, what is the deal. We just need to have a dual-stack DNS resolver somewhere, and that's it, no? Well, yes but actually yes.

There are two problems with this: First, this means that any new ISP needs to have at least some IPv4 address, even if they intend to just use IPv6 services. IPv4 addresses are scarce, expensive and small blocks don't route well, which is not great both from the new ISP's and from overal routing's point of view. It also hinders IPv6 deployment and postpones IPv4 abandonment, needlessly.

The second issue is that this is not very visible. We are building IPv6 world, but deep inside it still relies on IPv4, which might lead to great surprise when we start cutting off IPv4 internet. And it might lead to false sense of having IPv6 deployed, which is not true to the whole extent.

Insert "It was DNS" meme here.

Solution

The solution of this state is simple: get IPv6 connectivity to your authoritative DNS server (or use another) and do not forget to add an AAAA record for it in DNS. If the DNS server already has IPv6 it is probably just a matter of adding a single line to the zone file (and a second one for the DNSSEC signature), which should not be a big deal.

Unfortunately, this needs to be done for the whole DNS chain. Especially domain names at universities are infamous for very nested domains. A domain name may look like machine.department.location.faculty.university.some-common.suffix. That tree is deep and so is the resolution of this problem.

Amusing bug of almost good deployment

We have seen there may be multiple NS records for a domain and thus multiple nameservers. This is good for redundancy. But this does not mean that the servers will have the same records – they are only supposed to give equivalent answers (as far as I know).

I have come across a silly misconfiguration: a domain which has several nameservers, which serve a slightly different set of NS records for its subdomain. Specifically, the servers which were only reachable using IPv4 were exactly the servers that knew about one additional nameserver for the subdomain, which, incidentally, was the only one that was IPv6-capable.

So, while all the correct records were present in DNS (somewhat/somewhere), this still meant that IPv6-only resolution was doomed to fail because the IPv6 nameserver chain was broken. (This has already been fixed.)

[1]	This is very much the same as when you try to reach the IPv4-public-land from IPv4-private-land, that is, from a private range of IP addresses. This is called either just NAT, or NAT44 to denote IPv4-to-IPv4 NAT.

[2]	There are several more tests that do not even have the AAAA record, lol.

[3]	In my example, there is a single recursive DNS resolver external to my machine in order not to complicate it too much. The real deployment is often trickier.

[4]

I have not yet tried to run a recursive DNS in a network with DNS64 and NAT64. Could be fun :-D My wild guess is that I would need CLAT (i.e. the full 464XLAT deployment) to make that work, since the resolver is connecting directly to IPv4 addresses and would need to learn to use NAT64 to resolve them. (The CLAT could be built right into the resolver, though).

About this blog

2024-01-10T16:47:00+01:00

This is my blog and this article describes its setup and other details about my intentions. The actual setup is probably the most interesting tech-wise.

What is this?

My own space on the internet where I can post whatever and link others to it. It might end up containing rants, guides, ideas, or maybe nothing at all in the end. Only the future will tell.

The blog might even serve as my personal web page/introduction. Maybe. Maybe not…

The main motivation is to have low-effort way to post random stuff. Which leads to my requirements for this thing.

Requirements

(The requirements are a bit too idealistic, so not all of them were satisfied…)

low-effort, me-friendly, low-maintenance – I don't want to have to learn too many new technologies to use this. This includes the required technologies: Python, Markdown/reStructuredText, Jinja2, git, …
Technical and math content ~~friendly~~ compatible – I expect that to appear here.
Static site – for security, coolness factor and control. Also static on the front-end, because I don't like JavaScript and/or running untrusted code on my machine (even when in a sandbox). The SSG should likely be aimed at creating blogs, not documentation. Also, self-contained, as in not depending on third-party sites.
No moving parts in the infrastructure (or as few as possible) – if it works on my machine, it should just get mirrored to the public site with as few modifications as possible.
Transparent – I should be able to understand it, maybe others could also use it as a resource or take inspiration. (At one point, this deployment itself started being interesting, so if I can share the background as well as the final webpage, it would be cool.)
Followable – I know you internet guys like to ~~stalk~~ follow people :-)
Aligned with my values: minimalist, simple, extensible/hackable, FLOSS
If the platform could distinguish translations and do strikethroughs, it would be nice, but that is not a hard requirement.

There are several features of conventional blogs that I consider to be a non-goals or even anti-goals. Mostly it is about interactivity – I don't aim for having any kind of comments here, or really anything that would require JavaScript or complex HTML/CSS. And appearance goes past me as well, I instead try to let the browser decide how to display this page – more on that below.

The workflow I wanted to achieve is something like: Write the content, git it, build it (locally, no CI/CD), push it, done. Single write, single push, very simple.

And I managed to achieve something like that, via learning (too much?) about git.

The setup

Naturally for a sysadmin/netadmin, the setup consists of 7 ~~ISO/OSI~~ layers:

Physical layer: cheap Hetzner VPS. Not physical, but whatever.
Network layer: Nginx
Persistence layer: this git repo. I will elaborate below why can you see this both rendered here and in the source form in Forgejo.
Content layer: Markdown or reStructuredText files.
Business logic layer: Pelican. It's rather popular and written in Python, I didn't look further.
Presentation layer: I hacked my own theme, because I didn't like any in the pelican-themes repo. I was a bit inspired by the layout of eevee's blog, but I wanted a dark theme. And as you can see, I can't do quality frontend, so it ended up horrible… :-D
Stalking layer: Pelican's built-in RSS and Atom feed generators. Not linked from anywhere at the moment, but the repo will tell you what hides under the /feeds/ path. Or you can utilize the repo (for personal use – the content's license is not decided at the moment)…

Most of this is straightforward, the fancy part is my repo. The repo contains both source and rendered content, so that I can point Nginx right at a checkout and have Git solve both persistence and deployment without additional moving parts.

There are two tricks in the configuration of Git repositories: pushing to a checked out repo is enabled by configuring receive.denyCurrentBranch = updateInstead in the target repository (which is just a normal repo, not a bare one), and then I just told my source repositories [1] to use two push targets for the remote (the first line replaces the original push address for some reason):

git remote set-url --add --push blog_remote gitea@gitea.ledoian.cz:LEdoian/blog.git
git remote set-url --add --push blog_remote blog_user@blog.ledoian.cz:blog_dir

The blog user is just a user with SSH access via authorized keys, no special sauce there. Nginx is then pointed to serve ~blog_user/blog_dir/output/ at blog.ledoian.cz. (The git-remote(1) manpage requires me to have both repositories in sync, but as long as I configure all my repositories this way, I should be safe, and I think I could get away with my blog checkout getting behind accidentally.)

My workflow and lots of drafts

It's Git so it's only natural for me to use various branches and repositories even for a dumb blog. There are in fact 4 stages an article may go through [2]:

A private draft: lives on a branch priv/something, may contain private infos (like when I would just copy-paste from terminal without redaction) and this branch will probably never be merged to the main repo. Nothing about these branches is guaranteed.
A public WIP draft: uses a branch called pub/something which is pushed to Forgejo (and in fact also to the blog itself, but that is just an implementation detail). The draft is either does not build or is very incomplete and I expect to add stuff in a way that could break the build, so I put it on a separate branch. The branch will be probably merged to the main branch (called blog) when it is ready.

The pub/… branches can be created either manually or by cherry-picking from the respective priv/… branch, but that will likely not be distinguishable. (I am too lazy to keep the references even in the commit logs.)
When a draft is almost ready (or the content has simple syntax), it gets placed on the blog branch. The only thing that designates it as a draft is status: draft in the frontmatter, which means that the article will get rendered and put somewhere on the public blog, but not reachable from the title page ("unlisted").
Of course, eventually (and hopefully) the article gets published for everyone to see. At that point, it is complete (or at least that is what I thought when marking it as published). Possibly it might be updated in the future, but no such update is anticipated at the moment of publishing. [3]

I use Git to synchronize my private branches among machines, so there are actually two "server-side" repositories (private and public one) and thus two remotes. [4]

As for the actual workflow, for the main branch it usually consists of: writing content, committing it, building the web, checking it locally, committing the built blog and pushing it. Sometimes I do the commits together, but I always separate the rendering/building commits from the content-creating ones, so that I can handle those differently if needed (i.e. there is no point in cherry-picking the built content, I can generate it). [5]

For other branches I use some applicable subset of the steps above, probably.

Design considerations

The appearance of the blog is maybe not nice. That is for two reasons: I don't have the right idea about how to make it much better and I want to have a rather simple CSS for the web. The latter wish is because I tend to tweak appearance of sites I visit using my own styles, so I would like you to be able to do the same.

And for the former reason, if you have any ideas / improvements (including user styles), hit me at blog@pokemon.ledoian.cz :-)

My overall idea is a dark-by-default [6] minimalist page with a single menu on the right containig all the relevant links. The page should not dictate too much but rather let the user agent decide the rendering (it does anyway…).

I want my blog to render similarly in Gecko-, WebKit- and Blink-based browsers (e.g. Firefox, Badwolf, Qutebrowser). Others should be usable. Browser-/engine-specific styles are not welcome – let's keep it simple. And no JavaScript…

Work in progress / TODOs

This thing is at the moment very barebones, which is sufficient for the main purpose. However, I would like to have some features here, one day, hopefully:

Dates in the article headers (and maybe more improvements of the theme, see above)
Stable category and tag names and a page with a description of them. As of now I haven't really invented a system of sorting my content, which leads to a mess… Please don't rely on categories having any particular name / URL for now.
Link the RSS feeds from somewhere
Personal info with links to my other profiles
Some linking to the Fediverse and using it for comments (since there will be no comments here)
Sensible translations, maybe (if I/someone ever get to write the same content again in a different language…)
Improve the list of talks I've given (create some kind of sensible table maybe?)
Decide on a licence for the content (If you want to utilize something here before I do that, please ask me, I think we can find a way :-))

If you are so upset with this blog (or maybe bored) that you want to improve it, send me patches / ideas. I don't expect anyone to do that, though :-D (And I do not promise you that I will use the patch, even if it matches all my opinions above. I also have some gut feelings about what I like…)

Also, tell me if you hate something else about my page. I want to at least know whom I upset :-D (but I will probably also think about your gripes and whether I can and should try to avoid them…)

[1]	I also use multiple machines on which I can write stuff.

[2]

I am lazy and chaotic (good), so the stages are optional and non-linear, and sometimes involve paper. This article is a prime example: parts of it were on two different private branches, but at the end I wrote it from scratch directly on the main branch. And the requirements were written on a paper originally.

Nevertheless, the general idea still holds and may inspire others, so it makes sense to keep this part in the article. (Also, this footnote might not make sense before reading the definition of the stages, but I didn't find a better place to put it…)

[3]	Well, given this article contains some future plans, I actually anticipate update of this one, but maybe not in the near future. So the outline is not really correct, but I make the rules :-) (There were some build breaks on the main branch, too :-D)

[4] I would love if my Forgejo could have "private branches", but I understand that the overhead for doing this is not nice, since it would need to be able to decide for any object, whether it is public or not (you can do git fetch <remote> <object-hash>) and somehow keep track even with rebases, merges, force-pushes, many branches, … Having a separate private repository is not a big problem in comparison.

[5] Git purists might want to tell me that committing build artifacts is not good practice. I know and I explicitly don't care in case of this repo, because here I prioritise my own comfort of being able to check everything locally and then be reasonably sure the deployed version will also work, all this with only a single push somewhere. Of course, one could argue that with that there is no reason to create two commits, but it does not really bother me to run something like git commit -m"render" output/ when I am sure it works, and this keeps readable diffs separate from the non-readable ones (i.e. the changes in generated HTML).

[6] Having the page be dark-by-default is my preference, but I respect that others may prefer light sites. However, I have not yet determined what colors should be used (probably still cyan / blue / maybe purple-ish, but I don't know what shade) nor understood how to use @media(prefers-color-scheme) in a maintainable and simple way (in the context of my theme). So naturally, this is postponed to the future…

Smršť 2023 (CZ)

2023-12-02T18:00:00+01:00

Na Smršti jsem přednášel o distribuci SW a o technicky zajímavých železničních neštěstích.

Materiály

Slidy ke přednášce o neštěstích

(Pozn.: Možná se ještě změní adresa téhle stránky, protože je to celé WIP…)