Hi. This is a blog. It's mostly about math, I guess? Someday that might change.

Fourier Transforms via magic

[November 26, 2019]

A while ago I found a series of papers which do some wild magic with derivative operators:

  1. New Dirac Delta function based methods with applications to perturbative expansions in quantum field theory by Kempf/Jackson/Morales, 2014
  2. How to (Path-) Integrate by Differentiating also by Kempf/Jackson/Morales, 2015
  3. Integration by differentiation: new proofs, methods and examples by Jia/Tang/Kempf, 2016

The general theme is that evaluating functions on derivative operators , and applying this to delta functions , is occasionally useful and gives weird alternate characterizations of the Fourier transform and stuff like that.

The authors are physicists, unsurprisingly, and I’m sure there are a bunch of reasons why these results are either not that surprising or surprising-yet-not-useful, but I found them useful. However, when I revisited them trying to understand the ideas more closely, I found myself kinda overwhelmed and confused. So here’s a… totally different take, rederiving the main result by poking around.

tldr: the Fourier transform of is . Wait, what?

more...

A brief note about derivatives

[November 9, 2019]

A blog post led me to a paper, “Extending the Algebraic Manipulability of Differentials”, which makes a useful point about the notation we use for derivatives. This is a brief summary so I don’t forget it.1

Observation: the derivative operator can be decomposed into two steps: applying the differential operator to the target, then dividing by . It is useful to think of this as occuring in two steps, because it removes confusion in certain notations. Particularly, we will identify these two ways of writing the second derivative as meaning slightly different things:2

vs

  1. The paper itself has a bit of a sketchy pseudo-academic quality to it, spending a lot of time explaining things that every mathematician should know – but a good point is a good point, and I like any effort to improve notation. 

  2. note that this is not the same use of as is used in exterior algebra, with . That one requires additionally quotienting by relations like

more...

Aphantasia (and how not to do math in your head)

[September 15, 2019]

Most of our descriptions of how our brains work are fundamentally vague. We speak of our brains performing verbs like “think”, “realize”, “forget”, or “hope” but we aren’t talking about what’s going on mechanically to result in those qualities.

Sure, these can all be assigned truth values, in the sense that if everyone generally agrees that someone ‘realized’ something, we might define their brain to have performed the objective act of ‘realization’. But this gives no technical understanding of what the process of realization is – beyond, perhaps, some hand-wavey story about connections being bridged between neurons.

So, sometime in the last few years the English-speaking Internet became aware of the condition called aphantasia. Aphantasia is when a person is unable to picture images in their thoughts – they don’t have a “mind’s eye” at all.

This is interesting because, in contrast to the above, aphantasia is a concrete description of how the brain works. Some people see an image in their head when they draw or recall something; others don’t. Their brains work in materially different ways. I would have no idea how to figure out if two people “realize” something via different mechanisms, but I can be sure that two people’s brains operate differently, if one sees pictures and the others don’t.

more...

Exterior Algebra Notes #4: The Interior Product

[January 27, 2019]

Vector spaces are assumed to be finite-dimensional and over . The grade of a multivector will be written , while its magnitude will be written . Bold letters like will refer to (grade-1) vectors, while Greek letters like refer to arbitrary multivectors with grade .

more...

Exterior Algebra Notes #3: The Hodge Star

[January 26, 2019]

Previously: matrices and inner products on exterior algebras.

Vector spaces are assumed to be finite-dimensional and over . The grade of a multivector will be written , while its magnitude will be written . Bold letters like will refer to (grade-1) vectors, while Greek letters like refer to arbitrary multivectors with grade .

more...

All About Taylor Series

[December 28, 2018]

Here is a survey of understandings on each of the main types of Taylor series:

  1. single-variable
  2. multivariable
  3. multivariable
  4. complex

I thought it would be useful to have everything I know about these written down in one place.

These notes are not pedagogical; they’re for crystallizing everything when you already have a partial understanding of what’s going on. Particularly, I don’t want to have to remember the difference between all the different flavors of Taylor series, so I find it helpful to just cast them all into the same form, which is possible because they’re all the same thing (seriously why aren’t they taught this way?).

In these notes I am going to ignore discussions of convergence so that more ground can be covered. Generally it’s important to address convergence in order to, well, not be wrong. And I’m certain that I’ve made statements which are wrong below. But I am just trying to make sure I understand what happens when everything works, because in my interests (physics) it usually does.

more...

Infinite Summations and You

[November 1, 2018]

You may have seen that Youtube video by Numberphile that circulated the social media world a few years ago. It showed the ‘astounding’ mathematical result:

(quote: “the answer to this sum is, remarkably, minus a twelfth”)

…Then they tell you that this result is used in many areas of physics, and show you a page of a string theory textbook (oooo) that states it as a theorem.

The video caused a bit of an uproar at the time, since it was many people’s first introduction to the (rather outrageous) idea and they had all sorts of (very reasonable) objections.

I’m interested in talking about this because: I think it’s important to think about how to deal with experts telling you something that seems insane, and this is a nice microcosm for that problem.

Because, well, the world of mathematics seems to have been irresponsible here. It’s fine to get excited about strange mathematical results. But it’s not fine to present something that requires a lot of asterixes and disclaimers as simply “true”. The equation is true only in the sense that if you subtly change the meanings of lots of symbols, it can be shown to become true. But that’s not the same thing as quotidian, useful, everyday truth. And now that this is ‘out’, as it were, we have to figure out how to cope with it. Is it true? False? Something else?

more...

Exterior Algebra Notes #2: the Inner Product

[October 9, 2018]

(See this previous post for some of the notations used here.)

(Not intended for any particular audience. Mostly I just wanted to write down these derivations in a presentable way because I haven’t seen them from this direction before.)

(Vector spaces are assumed to be finite-dimensional and over )

Exterior algebra is obviously useful any time you’re anywhere near a cross product or determinant. I want to show how it also comes with an inner product which can make certain formulas in the world of vectors and matrices vastly easier to prove.

more...

Exterior Algebra Notes #1: Matrices and Determinants

[October 8, 2018]

(This is not really an intro to the subject. I don’t have an audience in mind for this. It’s notes that have been dressed up as a blog post, which may be useful if you’re trying to understand this stuff.)

(Vector spaces are assumed to be finite-dimensional and over with the standard inner product)

Exterior algebra (also known as ‘multilinear algebra’, which is perhaps the better name) is a pretty technical subject. It’s used in advanced mathematics, mostly abstract algebra and differential geometry, and comes up in physics a lot, often in disguise.

I happen to think it deserves to be far more commonplace, because it turns out to take a lot of the mysteriousness out of the otherwise technical and tedious subject of linear algebra, and it’s actually used all over the place; it’s just not so easy to tell that right now.

I study mathematics for fun, and am not sure if there’s any particular goal to it – but in general I’m drawn to whatever makes computation and intuition simple, and this is it. In college I learned about determinants and matrix inverses and never really understood how they work; they were impressive constructions that I memorized and then mostly forgot. Exterior Algebra turns out to make them into simple intuitive procedures that you could rederive whenever you wanted.

This stuff took me a long time to understand, so I’ve written up a lot of notes explaining it to myself. Maybe it will save you time.

more...

Oriented Areas and the Shoelace Formula

[August 6, 2018]

Here’s a summary of the concept of oriented area and the “shoelace formula”, and some equations I found while playing around with it that turned out not to be novel.

I wanted to write this article because I think the concept deserves to be better popularized, and it is useful to me to have my own reference on the subject. Some resources I have found, including Wikipedia, cite a 1959 monograph entitled Computation of Areas of Oriented Figures by A.M. Lopshits, originally printed in Russian and translated to English by Massalski and Mills, which I have not been able to find online. I did find a copy via university library, and I thought I would summarize its contents in the process to make them more available to a casual Internet reader.

I also wanted to practice making beautiful math diagrams. Which went okay, but god is it ever not worth the effort.

more...

Geometric Mean and Standard Deviation

[June 15, 2018]

A friend is writing her master’s thesis in a subfield where data is typically summarized using geometric statistics: geometric means and geometric standard deviations (GSD), and sometimes even geometric standard errors – whatever those are. And occasionally ‘geometric confidence intervals’ and ‘geometric interquartile ranges’.

Most of which are (a) not something anyone really has intuition for and (b) surprisingly hard to find references for online, compared to regular ‘arithmetic’ statistics.

I was trying to help her understand these, but it took a lot of work to find easily-readable references online, so I wanted to write down what I figured out.

more...

Existence is Pain

A Rant

[April 19, 2018]

My bike was stolen out of the backyard last night, so I’m feeling a little more aggravated by everything than usual.

This has had the effect of reminding me of a recurring sensation in my life as a software developer: that dealing with technology can be a fundamentally miserable experience, and that the skill of being ‘good’ at software is often mostly the same skill as being able to take a lot of crap from faceless, abusive machines in ways that you feel powerless to do anything about.

So while I’m all for the “let’s teach everybody to code!” movement, I do sometimes wish we’d stop writing yet another Learn Machine Learning With Python Tutorial, or whatever, and just make maybe take some time to work on making everything the world around us better in little incremental ways, by making what we’ve already got suck less, for ourselves and for all the newcomers and for just everyone, so we can have less stress and more peace in our lives.

Basically some days I can’t honestly tell anyone they should get into this, when on a good day you get to slowly hack your way through bullshit and on a bad day you might just succumb and give up.

more...

Meditation on Taylor Series

[March 30, 2018]

(Notes. Definitely not interesting unless, at minimum, you really really liked calculus.)


1

We can often write a differentiable function as a Taylor series around a point , approximating it in terms of its derivatives at that point:

And, under certain conditions, this series will converge exactly to the values of the function at nearby points.

more...

Some Intuition Around Entropy

[February 23, 2018]

(Only interesting if you already know some things about information theory, probably)
(Disclaimer: Notes. Don’t trust me, I’m not, like, a mathematician.)

I have been reviewing concepts from Information Theory this week, and I’ve realized that I never quite really understood what (Shannon) Entropy was all about.

Specifically: I have finally understood how entropy is not a property of probability distributions per se, but a property of streams of information. When we talk about ‘the entropy of a probability distribution’, we’re implicitly talking about the stream of information produced by sampling from that distribution. Some of the equations make a lot more sense when you keep this in mind.

more...

Blogging

[January 2, 2018]

In 2018 I am going to write. Mostly: because I don’t remember anything unless I write it out for myself. And a little bit: because I have a lot I want to say.