aboutsummaryrefslogtreecommitdiff
path: root/devtools/cmd
AgeCommit message (Collapse)Author
2026-03-26all: run go fix -stringsbuilderHana Kim
Change-Id: I839e47c2b39ee592909f7ecb03603d4fb1d1954b Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/753430 Reviewed-by: Jonathan Amsterdam <jba@google.com> kokoro-CI: kokoro <noreply+kokoro@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
2026-03-24all: pgx/v4 to v5 and upgrade pqEthan Lee
- In preparation for upgrade to PostgreSQL 17, upgrade stale dependencies within pkgsite. Change-Id: Id54cbb46182711b9808ee3bbbe2f0d5d9a04583d Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/758121 Auto-Submit: Ethan Lee <ethanalee@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Jonathan Amsterdam <jba@google.com> kokoro-CI: kokoro <noreply+kokoro@google.com>
2026-03-13all: fix forvarHana Kim
Change-Id: I02d2be535d9e3ac1788306adcc78d997d0caf951 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/753422 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Ethan Lee <ethanalee@google.com>
2026-03-12devtools/cmd/seeddb, internal/database: reduce contention and increase retriesHana Kim
Lower the concurrency limit of seeddb from 10 to 5 to reduce database contention. Increase the maximum number of transaction retries on serialization failure from 10 to 20 to improve reliability for large module insertions. Change-Id: Id57eea3bf7b7cf5554d4e99fbe68ac89bb355904 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/754540 kokoro-CI: kokoro <noreply+kokoro@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Ethan Lee <ethanalee@google.com>
2025-01-15devtools/cmd/seeddb: apply -keep_going to versions checkJonathan Amsterdam
Some module proxies may return invalid responses for versions for some modules. This change helps skip through those, when the majority of other modules would succeed. Concrete example: given a GitHub repo with no tagged releases, when querying the official Go module proxy for versions at /v@/list, it returns 200 OK and no content (since there are no versions). The jFrog Artifactory go module proxy's behaviour, in contrast, is to return 404 NOT FOUND if there are no versions. That means that if you're using seeddb and any of your seed.txt modules does not have tagged versions, we fail-fast when we try to list that module's versions, despite using -keep_going. This change applies -keep_going to that section of code, so that we skip over the 404 errors. Original author: Jean Barkhuysen <jean.barkhuysen@gmail.com> Fixes #71140 Change-Id: I2ccbcc356c322deed81860ee92274fba04a079b2 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/641675 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Michael Knyszek <mknyszek@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Jean Barkhuysen <jean.barkhuysen@gmail.com>
2024-11-13devtools/cmd/seeddb: improve loggingJonathan Amsterdam
- Use the stdlib log package, to distinguish seeddb logs from pkgsite logs. - Log events as they happen, instead of at the end. Change-Id: Ia3877e821def72d89144ad50d2b6706bb531eb1c Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/626857 Reviewed-by: Hyang-Ah Hana Kim <hyangah@gmail.com> Reviewed-by: Robert Findley <rfindley@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> kokoro-CI: kokoro <noreply+kokoro@google.com>
2024-08-22devtools/cmd/seeddb: limit concurrencyJonathan Amsterdam
Limit the number of goroutines that are fetching modules at once, to reduce the chance of transactions timing out. We've been noticing kokoro failures due to that recently. I chose a limit of 10 arbitrarily. We'll see if it helps. I tried testing locally, but I don't get the same behavior as on kokoro. Also, use an errgroup with a context to clean up seeddb failures faster. Also, remove the seeddb flag permanently. Change-Id: Ib0244c76572c9f9e34064f99a05b26d70cc55aea Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/607755 Reviewed-by: Robert Findley <rfindley@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Hyang-Ah Hana Kim <hyangah@gmail.com>
2024-03-04tests/screentest: fix bug in scriptJonathan Amsterdam
Missing backslash was causing a panic. Change-Id: I630acd72a56a2d6242f64b17e6a4f944cb5b1c75 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/568239 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Michael Matloob <matloob@golang.org>
2024-02-26devtools/cmd/dumpdoc: add symbol docJonathan Amsterdam
Add the documentation for all the exported symbols to the output file. Change-Id: I25270765d81f78c3ff558243fea726fa68da65a3 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/566495 kokoro-CI: kokoro <noreply+kokoro@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Tatiana Bradley <tatianabradley@google.com>
2024-02-23devtools/cmd/dumpdoc: tool for writing out package documentationJonathan Amsterdam
This is a tool for an experiment. It reads package documentation from the database and writes it to a file in gob format. Change-Id: I3b6cfde24ce155a647c3c43caff68be63832f80f Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/566416 kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Tatiana Bradley <tatianabradley@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
2024-01-18devtools/cmd/db: show waiting queriesJonathan Amsterdam
Add a subcommand to show which queries are waiting for others. Change-Id: Ia5b9f40c4ca45e81b63fe24a4e987cceaf8267ce Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/555460 TryBot-Result: Gopher Robot <gobot@golang.org> TryBot-Bypass: Jonathan Amsterdam <jba@google.com> Reviewed-by: Michael Matloob <matloob@golang.org> Run-TryBot: Jonathan Amsterdam <jba@google.com>
2024-01-03devtools/cmd/wait_available: add timeout flagMichael Matloob
And properly set the timeout flag in devtools/docker/compose.yaml and tests/screentest/run.sh instead of dropping it. Change-Id: I6aeee276b5fe1d01bef2b809b017a570c4f73368 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/553535 TryBot-Result: Gopher Robot <gobot@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com> Run-TryBot: Michael Matloob <matloob@golang.org> kokoro-CI: kokoro <noreply+kokoro@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Dan Peterson <danp@danp.net>
2023-12-24third_party/wait-for-it: replace with a simple go programMichael Matloob
The program doesn't have all the features of wait-for-it, but it implements the core functionality we need. For golang/go#61399 Change-Id: Ia5498523e44b74dcd5af1c984521f1a46208d2c5 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/552295 kokoro-CI: kokoro <noreply+kokoro@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2023-08-29internal/proxy: inject transport in proxy.NewMichael Matloob
This removes the dependency from internal/proxy on ochttp. For golang/go#61399 Change-Id: Ib2a350151752dc18c9a6e03b38b2d423ed55f4a1 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/523513 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Run-TryBot: Michael Matloob <matloob@golang.org> TryBot-Result: Gopher Robot <gobot@golang.org> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Robert Findley <rfindley@google.com>
2023-08-29internal/source: inject *http.Client into source.NewClientMichael Matloob
This removes the dependency from package source onto ochttp. The users of source.NewClient that want an ochttp.Transport can set the transport on the *http.Client. For golang/go#61399 Change-Id: Ifb7126c482f664ee5a359f594d9324f0fd90f8b2 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/523510 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Robert Findley <rfindley@google.com> TryBot-Result: Gopher Robot <gobot@golang.org> Run-TryBot: Michael Matloob <matloob@golang.org> kokoro-CI: kokoro <noreply+kokoro@google.com>
2023-08-25internal/config: separate config initialization into serverconfigMichael Matloob
This change creates a new package that does config initialization and other GCP-specific operations that were previously done in package config, so that config can have no cloud dependencies. For golang/go#61399 Change-Id: I8d78294834e325b47d838892a1cef87003a4b90a Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/522516 Run-TryBot: Michael Matloob <matloob@golang.org> TryBot-Result: Gopher Robot <gobot@golang.org> Reviewed-by: Robert Findley <rfindley@google.com> kokoro-CI: kokoro <noreply+kokoro@google.com>
2023-08-04all: switch from github.com/ghodss/yaml to gopkg.in/yaml.v3Michael Matloob
yaml.v3 is the more widely used yaml. The main difference between the two is that ghodss converts yaml to JSON as an intermediate to marshalling and unmarshalling. That means we need to add yaml struct tags to use yaml.v3. Add yaml tags to ConfigOverride and QuotaSettings because yaml.v3 lowercases the names of fields by default and the configs have used uppercase names. Change a test experiment config to use lowercase names since that's what's used in most other configs. For golang/go#61399 Change-Id: Id7f09f2635ee013506b1573bfe555ec0348e60e4 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/514522 TryBot-Result: Gopher Robot <gobot@golang.org> Run-TryBot: Michael Matloob <matloob@golang.org> Reviewed-by: Hyang-Ah Hana Kim <hyangah@gmail.com> Reviewed-by: Jamal Carvalho <jamal@golang.org> kokoro-CI: kokoro <noreply+kokoro@google.com>
2023-02-22internal,static: upgrade esbuildJamal Carvalho
The previous version of esbuild would sometimes out non-deterministic versions of minified files. This would generate large diffs when make small changes to script code on different machines. Change-Id: I30540088ad2a259e4c086b18505016a95937dc2f Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/469855 Run-TryBot: Jamal Carvalho <jamal@golang.org> Reviewed-by: Hyang-Ah Hana Kim <hyangah@gmail.com> TryBot-Result: kokoro <noreply+kokoro@google.com>
2022-06-17many: re-enable staticcheck and fix problemsJonathan Amsterdam
Most of the checks were about io/ioutil. There were a couple of other minor ones. I didn't address the check for strings.Title; instead, I turned off that check globally with a staticcheck.conf file. Change-Id: I286a6894fb1fd891818ab9e451c891f52a3828fc Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/412675 Reviewed-by: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com>
2022-04-11all: gofmtRuss Cox
Gofmt to update doc comments to the new formatting. For golang/go#51082. Change-Id: Ia9e71e7ecac75822ff43d6c7e60f512442a5fa50 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/399617 Run-TryBot: Russ Cox <rsc@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Auto-Submit: Russ Cox <rsc@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-09-29devtools/cmd/seeddb: support bypassing the license checkJonathan Amsterdam
For golang/go#48566 Change-Id: Ia775d7a37924ec509a782227c099055fe5ebfc0c Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/352900 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com>
2021-09-27devtools/cmd/seeddb: add -keep_goingJonathan Amsterdam
Add a flag that continues fetching modules even if there is an error. For golang/go#48587 Change-Id: I9df1070ee9bb0e206ddd569228239bde5bcb05cd Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/352489 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-09-08devtools,static: delete unused JS filesJamal Carvalho
Now that we're bundling TS files we no longer need to build JS files for the shared code. Change-Id: I48c8c0b574d3e9377074ec186805bc7e9c66555e Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/348369 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-08-23devtools,static: move generated readme styles to unit directoryJamal Carvalho
Change-Id: Iaad83f816f3080fce9a689de8a0f726b5c08cacd Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/344395 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-08-11devtools/cmd/seeddb: process versions of the same module sequentiallyJonathan Amsterdam
This time for real. Before we were only processing the versions expanded from "@all" sequentially, so if there were two lines in the seed file M@v1.1.0 M@v1.2.0 they would still be processed concurrently. Now we handle that case as well. Change-Id: I6051ff622d68c316386e7c09de6ddf603c8ab273 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/341349 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-08-10internal: add ParseModverJonathan Amsterdam
Change-Id: I301e4b13b13dcc04afd9282ba4e4e9237097a458 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/340709 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-08-06devtools/cmd/seeddb: process same module sequentiallyJonathan Amsterdam
Process multiple versions of the same module sequentially. Doing so in parallel causes DB contention because of the lock on the module path and other ordinary DB locks. This can cause a fetch to reach the limit on the number of transaction retries. Change-Id: Ibb58e583441e0b471a628edd1b64ec7f8010e174 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/340118 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-08-05internal, etc.: factor out (module path, version) pairJonathan Amsterdam
A lot of code reinvents the type that is a pair of module path and version. Factor out to a single type. Change-Id: I729214ebc45c0d496b6b03a5f8a8c17410836572 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/340109 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-08-02devtools/cmd/seeddb: do not refetch existing modulesJulie Qiu
By default, the seeddb script no longer refetches modules if it already exists in the test database. This makes it faster to rerun the e2e and search tests locally, so that modules do not need to be refetched after each test run. The -refetch flag can be used to refetch existing modules. Change-Id: If503111202c987a56ccb888e89501730207b8168 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/338933 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-07-26internal: add ReadFileLinesJonathan Amsterdam
Factor out this commonly used function to the internal package. Also, update some comments in devtools/cmd/seeddb. Change-Id: I0276ce51d0dd1f4aafa2f6c562d1b83ce21a0d14 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/337330 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org> Reviewed-by: Julie Qiu <julie@golang.org>
2021-07-20devtools,tests: move seed filesJulie Qiu
Seed files are moved to the relevant tests/* directories, so that they are in the same location as other config files. Change-Id: I18771d15f5ef0d7cd7f3c271749a202962736f71 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/335392 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-20tests/search: add setup for testing searchJulie Qiu
A method is added for testing symbol search. See tests/README.md for set up details and tests/search/scripts/symbolsearch.txt for an example. These tests run in the searchtests docker container and can be run using tests/search/run.sh test/search/run.sh do not pass yet, since the symbol search query needs to be fixed, but in the future they will run in CI. For golang/go#44142 Change-Id: I0a2d6818e9874385a0bd79d668cce63495a363c3 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/333934 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-19cmd,devtools,internal/config: set log level in config.InitJulie Qiu
log.SetLevel is now called in config.Init, so that it also applies to logs in the Init function. Change-Id: Id552923b4d81bb1678b8ffa72f1b1d858de559c1 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/335257 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-07-19devtools/cmd/db: clean upJulie Qiu
* Add migrate commond to flag.Usage * Move each switch statement to a helper function for readability * Only try to connect to the database for truncating; the database won't exist if we are trying to create it * Don't fail we if try to create a database that exists * Don't fail we if try to drop a database that does not exist Change-Id: I8e06c76edaa6eaeb42fd1e95b8f084358306c283 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/335256 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-19devtools/cmd/seeddb: filter stdlib versionsJulie Qiu
It's relatively expensive to fetch a stdlib module version, so when std@all is specified, only fetch the minor versions (ones with a patch version of 0). Change-Id: Iabf31977ca068a61f7fbbcd38f6da25c14b65082 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/335133 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-19devtools/cmd/db: use GO_DISCOVERY_DATABASE_NAME instead of argJulie Qiu
Since we use GO_DISCOVERY_DATABASE_NAME throughout the rest of our scripts to set the database name, it is easier to use that environment variable than type the dbname for consistency with other scripts. Change-Id: If4ce7c3c01f53df963619d73e7f6e0b7188d9e9a Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/335138 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-16devtools/cmd/db: setup db scriptsJulie Qiu
We currently have two different setups for our databases with local development, one using the CLI tools and one with Go scripts. Instead, a script is now added at devtools/cmd/db to consolidate places where logic is implemented. Existing scripts are still maintained for ergonomics, but they just invoke the relevant devtools/cmd/db command. The devtools/cmd/db script will also be used in a later CL to simplify the docker setup. We no longer need the seeddb and migrate containers, since they can be reduced to a Go binary. Change-Id: I6d9fcdd452ab024bcffd91bf3f6f15598f4e502b Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/333937 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-12devtools/cmd/seeddb: support fetching all version of a moduleJulie Qiu
The seeddb script now supports syntax for fetching all versions of a module, by adding <module>@all to a seed file. Change-Id: Ia609df5033ac5522d0eb1d17d024453bd3b0e1bc Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/333156 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-07-12devtools: add GO_DISCOVERY_SEED_DB_FILE to customize seed fileJulie Qiu
The GO_DISCOVERY_SEED_DB_FILE variable is now used to determine which seeddb file should be read by the seedb container in docker-compose. This allows us to use different files for development and the e2e tests. The seedfile for e2e tests is renamed to e2e_test_modules.txt, to make it clear what the file was used for. In future CLs we will also have additional seed files. Change-Id: I5c3c64386f419b582b043d933482bcc84f186495 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/333153 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-07-12devtools/cmd/seeddb: support experimentsJulie Qiu
The seeddb script now supports experiments, which can be set using GO_DISCOVERY_CONFIG_DYNAMIC. Change-Id: I491776b3a4aca5646b613bdee393794d065e38a1 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/333154 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-12devtools/cmd/seeddb: remove extra seeddb directoryJulie Qiu
devtools/cmd/seeddb/seedb had an extra level of nesting that wasn't necessary. Change-Id: I997d97fba0339ca08645fa1a29ba7c3a40caf30c Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/333151 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-06-16devtools/cmd/seeddb/seeddb: fix scriptJulie Qiu
Since seeddb is moved to devtools/cmd/seeddb/seeddb, cmd/internal/cmdconfig can no longer be used. Instead, use database.Open directly. Change-Id: I2262d36f2199a275dbc62306528788bdf21f0727 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/327932 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-06-16devtools/cmd/seeddb: moved from cmd/internal/seeddbJulie Qiu
Pure code in motion. Tests are fixed in the next CL. Change-Id: Ib59f59cad231baab763c6f74ba1f8aaf995063ee Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/327931 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-06-12devtools,internal: build new static assetsJamal Carvalho
The static build devtool builds the TypeScript files in static and ignores content/static. Unused config options like Write are removed and support is added for bundling files together. The command walks a given directory and collects files it determines to be entry points. Files prefixed with an underscore are assumed to be imported in an entrypoint file and ignored. Change-Id: I7c62afd36ff4ee327d528919c54866631a9c73f7 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/327281 Trust: Jamal Carvalho <jamal@golang.org> Reviewed-by: Julie Qiu <julie@golang.org>
2021-06-07content,internal: update pages to use new base layoutJamal Carvalho
Moves pages into domain specific directories and updates the template parsing logic to begin the switch to the new base layout. The unit page migration will come in a later CL. Change-Id: I424643146aacaefd61e88cb9a767b9d4b581aa5e Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/324391 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> Reviewed-by: Julie Qiu <julie@golang.org>
2021-05-19devtools,internal: adds support for building styleguide assetsJamal Carvalho
Change-Id: I6bd95b076c1e2715ae574d2802ca75a71bb3e747 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/320652 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-03-10devtools/cmd: fix static checkJamal Carvalho
Change-Id: I9e9e18eddce1dd57093e27a7db4afa24669093fe Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/300551 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-03-10devtools,internal: add support for checking JS outputJamal Carvalho
Adds a check feature to the static command to ensure that the JS output is correct for the current set of TS source files. Change-Id: I4f805883f2ef6d30b888a915024585197049278d Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/300231 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-03-10devtools,internal: configuration for esbuildJamal Carvalho
Sets up configuration for esbuild, a JavaScript bundler written in Go that has support for TypeScript. This tool will replace the TypeScript compiler in building our frontend scripts. It is much faster and has no dependencies. Run "go run devtools/cmd/static/main.go" to compile TypeScript code for production or "go run cmd/pkgsite/main.go -dev" to compile TypeScript code for development and rebuild on file changes. Fixes golang/go#42540 Fixes golang/go#43359 Change-Id: I5ddc1b716587ee5bdd897891d4972158782dbb49 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/300074 Reviewed-by: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org> Trust: Jamal Carvalho <jamal@golang.org>
2021-01-08content: remove postcss processed stylesJamal Carvalho
Removes PostCSS cli dependency and minified CSS files. Reverts the changes from https://golang.org/cl/281772 to simplify the development process for CSS files. We may revisit minifying and bundling CSS with a Go package in the future. Change-Id: I34936eefc0d9aced9a13badace2c950f53ac84da Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/282376 Reviewed-by: Julie Qiu <julie@golang.org> Trust: Jamal Carvalho <jamal@golang.org>
generated by cgit v1.3 (git 2.53.0) at 2026-04-15 09:35:21 +0000