Django migrations
Read these files first, before writing or editing a migration:
docs/published/handbook/engineering/developing-locally.md(## Django migrations,### Non-blocking migrations,### Resolving merge conflicts)docs/published/handbook/engineering/safe-django-migrations.mddocs/published/handbook/engineering/databases/schema-changes.mdproducts/README.md(## Adding or moving backend models and migrations) when working inproducts/*
If the task is a ClickHouse migration, use clickhouse-migrations instead.
Workflow
- Classify the change as additive (new nullable column, new table) or risky (drop/rename,
NOT NULL, indexes, constraints, large data updates, model moves). See also the cross-languageNOT NULLhazard below. - Generate:
DEBUG=1 ./manage.py makemigrations [app_label]. For merge conflicts:python manage.py rebase_migration <app> && git add <app>/migrations(posthogoree). - Apply safety rules from
safe-django-migrations.md— the doc covers multi-phase rollouts,SeparateDatabaseAndState, concurrent operations, idempotency, and all risky patterns in detail. - Validate:
./manage.py sqlmigrate <app> <migration_number>, run tests, confirm linear migration sequence.
Cross-language NOT NULL hazard
posthog_user, posthog_team, and other core tables in the main Postgres database are written by Django and by nodejs/ (plugin-server tests via insertRow), rust/ services, and Temporal workers. Those non-Django writers issue raw INSERTs that only list the columns they care about, so any new NOT NULL column without a Postgres-level DEFAULT will break them with null value in column "<col>" violates not-null constraint.
Django's default= alone does not create a Postgres-level default — by design, Django treats it as a Python-only attribute applied at Model.__init__:
- Callable defaults (
default=list,default=dict,default=uuid.uuid4) are never emitted into SQL at all. - Scalar defaults (
default=False,default=0,default="") are emitted asADD COLUMN ... DEFAULT X NOT NULLand then immediately dropped by a follow-upALTER COLUMN ... DROP DEFAULT— verify with./manage.py sqlmigrate.
Before merging, grep for external writers of the table:
rg -n "INSERT INTO <table>|insertRow\(.*'<table>'" nodejs rust products services
If any match, add both default= and db_default= to the model field. db_default= lands a real Postgres DEFAULT; default= keeps the Python-side value for ORM creates:
class User(models.Model):
hide_mcp_hints = models.BooleanField(default=False, db_default=False, null=False)
makemigrations will emit a plain AddField(..., db_default=False, default=False, ...), and sqlmigrate shows just ADD COLUMN ... DEFAULT false NOT NULL — no DROP DEFAULT follow-up.
db_default= is also load-bearing for the nodejs / rust test suites. posthog/management/commands/setup_test_environment.py calls disable_migrations() and builds the test schema directly from model definitions, skipping the migration entirely. Plain default= is invisible to that path; db_default= is what Django bakes into the generated CREATE TABLE. Without it, the postgres-parity and Jest jobs in .github/workflows/ci-nodejs.yml will fail on raw INSERTs even though ./manage.py migrate looks correct in isolation.
For modifying the default on an existing column (no ADD COLUMN), use a plain RunSQL instead:
migrations.RunSQL(
sql="ALTER TABLE <table> ALTER COLUMN <col> SET DEFAULT '[]'::jsonb;",
reverse_sql="ALTER TABLE <table> ALTER COLUMN <col> DROP DEFAULT;",
)
Always verify with ./manage.py sqlmigrate <app> <number> that no stray DROP DEFAULT slipped through, and confirm ./manage.py makemigrations --dry-run reports no state drift.