‹ BackHN Continuity

Thread

Footguns with Postgres “at time zone 'UTC'”

169 points · 114 comments · birdculture

  1. ulrikrasmussen · · focus · HN ↗
    The SQL standard is unfortunately really horrible when it comes to handling of time. The type `timestamp` is not a timestamp at all because it doesn't encode a unique point in time, it just stores a date and a time which has to be interpreted relative to a timezone. It should be called "datetime".

    Moving a Java Instant back and forth between a database is also a surprisingly difficult task to do right, and it doesn't help that JDBC is just handling it completely wrong if you use its setTimestamp/getTimestamp methods. Not because it is a bad design with footguns, but because the implementation is just plain wrong and will corrupt your data if you deal with instants whose calendar date is far enough in the past due to it using the legacy date/time API which switches to the Gregorian calendar for dates in the past.

    The name `timestamp with time zone` is also misleading because it doesn't actually store a time zone, it stores the number of seconds since epoch like a java.time.Instant (although at a different resolution). The "with time zone" part just refers to the textual format you denote the values in which includes the time zone after the date/time part to uniquely identify a timestamp, but the time zone is thrown away and not stored after the value has been parsed. This is different from e.g. `ZonedDateTime` in Java which will actually store the offset and therefore corresponds to a pair of (Instant, TimeZone).

    1. masklinn · · focus · HN ↗
      A ZonedDateTime is not an instant and a timezone, for the same reason that you can’t unambiguously round trip between arbitrary timezones and UTC:

      - zoned datetimes carry ambiguities as to their actual location on the timeline (because they can repeat, or not exist at all)

      - future zoned datetime carry outright uncertainty as to their actual location on the timeline (as the zone’s offset can be updated at any point and any number of times until the event has elapsed)

      1. rawling · · focus · HN ↗
        Has anyone proposed versioning timezones? Or is this such an edge case it would be overkill? (Either specify your future instant in UTC if you mean to stick to that, or specify it in a timezone and accept that it could change before it happens, or if you need something else get it in a contract and don't trust the computer!)
        1. pseidemann · · focus · HN ↗
          There is actually a simple heuristic you can use: if a point in time should be sticky to a calendar (e.g. calendar app or appointments which need to be synchronized between multiple humans or parties for a given context/location/region), store a datetime _without_ a timezone and make the timezone configurable for the user/infer it from the user. If you want a point in time which will not "physically" change, store a datetime _with_ a timezone, always, preferably UTC (e.g. logging, timers, measuring the occurrence of events).
          1. skrtskrt · · focus · HN ↗
            What’s the difference between these two other than how the client would convert to display to a user?
            1. pseidemann · · focus · HN ↗
              It's not only about display. If you store a user's appointment only as a UTC timestamp, you actually can't know the hour of the day (and the day itself to be precise) on which this appointment should happen, for a given calendar (probably the user's calendar, in a specific non-UTC timezone). You would have to guess by using the calendar's/user's timezone and compute some offset with UTC. But what if the user changes timezones or the timezone itself changes its value? Store without a timezone, and you know the exact hour and day the user intended. One is pointing to a day and hour in a calendar, the other is pointing at a point on the line of a linear timeline.
              1. skrtskrt · · focus · HN ↗
                You're still just talking about client conversion on the write instead of the read. A Unix epoch is a UTC timestamp. That number is not time-zone-less it's just in the default computer time zone.
                1. pseidemann · · focus · HN ↗
                  I'm referring to a "datetime", which should be a data type which stores a date, e.g. "2026-09-28", and a time, e.g. "16:58:18". The unix epoch is not relevant here, unless you _want_ to store a UTC timestamp. You could store a UTC timestamp also as ISO 8601, which is not a number. But this is not related to the timezone-less datetime I'm talking about. To make my points more clear, just imagine the datetime is stored as a string "2026-09-28 16:58:18" with no implied timezone whatsoever.
                  1. skrtskrt · · focus · HN ↗
                    But there is zero use case difference between these two things you mentioned:

                    > if a point in time should be sticky to a calendar store a datetime _without_ a timezone

                    > If you want a point in time which will not "physically" change, store a datetime _with_ a timezone

                    Both of these things are exactly identical. You are still storing an exact point in time in both cases. The only thing about a calendar use case is the presentation layer.

                    1. pseidemann · · focus · HN ↗
                      > You are still storing an exact point in time in both cases.

                      No this is not correct. You store two different intents. Suppose you want a reminder in your calendar every day at 15:00 for the next 7 days. It should not change if DST changes in the middle of the seven days. It should not change if legislation of my timezone changes. How do you encode this? A UTC timestamp for each of the seven days will change the hour if the DST changes or the timezone changes. So what you can do is store a datetime _without_ a timezone, exactly reflecting what the user entered when creating the calendar entry, which is "2026-09-29 15:00:00", "2026-09-30 15:00:00", etc. This is the intent wanted by the user, which is a "sticky" time in their calendar. These are not exact points in time, since timezones can and will change (DST), so the "physical" instant of 15:00 can be a different "actual" (as in, the sun has a different position, earth rotation is different) time when comparing the days. Instead, these are exact times in 7 days only in a (specific) calendar.

                      1. skrtskrt · · focus · HN ↗
                        That system you described is quite rare - it would have to poll N databases of N possible events constantly to see if it should give you a reminder. Which is why none of the common calendar systems do that.

                        They just create events, which have a time zone and represent and exact point in time. And they don't change the event or when you get notified when you change time zones.

                        1. [deleted] · · focus · HN ↗

                          [deleted]

            2. jasode · · focus · HN ↗
              The 2 different types of datetimes encode different information and is not purely a display/presentation issue, it's also storage issue.

              I happen to call them "scientific datetime" vs "cultural/political datetime". However, the software dev industry has not converged on a standard vocabulary to delineate the 2 types which is unfortunate because that means programmers are unaware that the difference exists. Concepts are more top-of-mind when there are good names to label them.

              If a programmer doesn&#x27;t understand how the 2 datetimes behave differently, they will create software bugs as I&#x27;ve outlined before: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=39418897">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=39418897

              There&#x27;s the meme of &quot;store UTC everywhere&quot; (maybe perceived as correct because of superficial similarity to &quot;use UTF-8 everywhere&quot;) ... but storing datetimes as UTC is only unambiguous for historical events such as timestamps of activity stored in server logs.

              But future datetimes can have ambiguous edge cases which causes the split into 2 different types.

              1. pseidemann · · focus · HN ↗
                What you call &quot;cultural&#x2F;political datetime&quot; should be &quot;standard time&quot; (or maybe &quot;civil time&quot;):

                <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Standard_time" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Standard_time

                But this is still different to a time someone enters into a calendar. Standard time can change its offset (to UTC) over time (e.g. DST), while a time in a calendar is fixed in the nominal sense.

                &quot;scientific datetime&quot; is quite ambiguous, since I would consider science-level precision time to be TAI (International Atomic Time, what UTC uses as a reference), or maybe UT1, which is one variant of UT (Universal Time, unrelated to UTC), depending on the scientific field. For simple cases, UTC might be enough, so you could call this &quot;UTC&quot;.

                I think practically what matters for developers are three things:

                - Standard time (dependent on timezone)

                - UTC (the reference for standard times in the different timezones)

                - Calendar times (seems to be called &quot;floating time&quot; [0]), just referring to a specific date and time, usually independent from both standard time and UTC, from the author&#x27;s perspective (others viewing a foreign calendar might see times interpreted in their own timezone). Often scoped by physical location, but not necessarily.

                [0]: <a href="https:&#x2F;&#x2F;www.w3.org&#x2F;TR&#x2F;timezone&#x2F;#floating-times" rel="nofollow">https:&#x2F;&#x2F;www.w3.org&#x2F;TR&#x2F;timezone&#x2F;#floating-times

                1. jasode · · focus · HN ↗
                  , while a time in a calendar is fixed in the nominal sense.

                  The above scenario of fixed time regardless of DST&#x2F;TZ changes is what I tried to call &quot;cultural&#x2F;political time&quot;. In other comments, I called it &quot;appointment time&quot;.

                  What you call &quot;calendar time&quot;, others will call it &quot;time with calculated UTC offset&quot;. (Which then leads to more meta discussion of &quot;no... calendar time is not UTC offset because ...&quot; )

                  Both examples of our ambiguous labels causing more confusion is prime example of the industry not converging on good names to make devs aware of the difference.

                  &gt;I think practically what matters for developers are three things:

                  That categorization is fine but is still obscuring the key issue: many developers think they can collapse all of your 3 types into one simple strategy of &quot;always store it as UTC&quot;

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.