aboutsummaryrefslogtreecommitdiff
path: root/internal/worker/server.go
AgeCommit message (Collapse)Author
2026-03-27all: run go fix -stringscutprefixHana Kim
Change-Id: I3c0a7e155ead790300ebe53e090ef9a42e655d3e Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/753432 kokoro-CI: kokoro <noreply+kokoro@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2026-03-26all: fix rangeintHana Kim
Change-Id: I58ed5e7d2a3bbc13bc389ac7239737e18856dbfe Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/753427 Reviewed-by: Jonathan Amsterdam <jba@google.com> Reviewed-by: Ethan Lee <ethanalee@google.com> kokoro-CI: kokoro <noreply+kokoro@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
2026-03-13all: fix forvarHana Kim
Change-Id: I02d2be535d9e3ac1788306adcc78d997d0caf951 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/753422 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Ethan Lee <ethanalee@google.com>
2026-02-24internal/worker: add an option for in-process periodic poll/enqueue-ingJean Barkhuysen
Fixes golang/go#77689. Change-Id: Id754eeafdc8b680acb1aa137225292c808d0bf04 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/747880 Reviewed-by: Jonathan Amsterdam <jba@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: David Chase <drchase@google.com>
2025-10-28all: remove code for the decommissioned beta environmentNicholas S. Husin
The beta environment is no longer in use. This change removes related logic and references, such as the middleware redirect to beta.pkg.go.dev. Change-Id: I0c6ebbe11d5689ccf2abf8c722399d8dc339db89 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/715321 kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Michael Matloob <matloob@google.com> Reviewed-by: Michael Matloob <matloob@golang.org>
2025-10-23all: fix some commentscuishuang
Change-Id: Ia70b35ab9aef270692a3892629c3c81208771089 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/713360 Reviewed-by: Dmitri Shuralyov <dmitshur@google.com> Reviewed-by: Sean Liao <sean@liao.dev> kokoro-CI: kokoro <noreply+kokoro@google.com> Auto-Submit: Sean Liao <sean@liao.dev> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: David Chase <drchase@google.com>
2025-07-04internal/worker: Add since form param to /poll.Jean Barkhuysen
If the worker's latest timestamp is t, it's hard to get it to back and re-poll the index for older work. This CL adds a very simple utility that lets you do so. Change-Id: If12d385e245b6e64880dd7aa704b749603c7fecc Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/685455 kokoro-CI: kokoro <noreply+kokoro@google.com> Auto-Submit: Jonathan Amsterdam <jba@google.com> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Dmitri Shuralyov <dmitshur@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2024-03-01internal/middleware,etc.: store requestsJonathan Amsterdam
This CL provides several improvements to the worker home page: - Display all requests, not just fetches. - Link to the logs for each request. - Link that will cancel a request. At the heart of these changes is a new piece of middleware that tracks all active requests, along with their trace ID and a function that can be used to cancel them. This change also affects logging, because the logger doesn't need to maintain its own trace ID. Change-Id: Id022170073d2d7ca4e45aaa1d78b216d8a512f35 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/568236 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Michael Matloob <matloob@golang.org> kokoro-CI: kokoro <noreply+kokoro@google.com>
2024-02-29internal/worker: improve template-parsing codeJonathan Amsterdam
We can turn some repeated code into a loop by using a function that can create a TrustedSource from a dynamic string. Change-Id: Id1bed179bfe3cf22585e44f03482f385a0163f06 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/568235 kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Michael Matloob <matloob@golang.org> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
2024-02-27internal/worker: improve home and debug pagesJonathan Amsterdam
- Move excluded prefix list to a separate page. - Move debug pages under "/debug". (Previously the dcensus ones weren't even exposed.) - Add links to debug pages at top of home page. Change-Id: If26e139984b34cb6b2ef78af8ef154d96436a26a Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/566418 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Michael Matloob <matloob@golang.org>
2024-02-22internal/worker: add batch param to update-imported-by-count routeJonathan Amsterdam
Inserting 5000 imported-by counts into search_documents timed out. Make that size configurable, so we can experiment with something smaller. Change-Id: Ie0c5f42a28c0468c600af6d836edc345529b769f Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/565682 LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com> Reviewed-by: Michael Matloob <matloob@golang.org> kokoro-CI: kokoro <noreply+kokoro@google.com>
2024-02-21internal/worker: fetch returns 404 on m@vJonathan Amsterdam
We were parsing a fetch path of module@v1.2.3, but returning a version of "1.2.3", not "v1.2.3". But we shouldn't accept this syntax at all, only the proxy syntax "module/@v/v1.2.3". Make that behavior change, but also improve both parseModulePathAndVersion and its test. Change-Id: I5e085b4845a939458838ca6f6da6600c854ed9d4 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/565676 kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Michael Matloob <matloob@golang.org> LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
2023-08-25internal/config: separate config initialization into serverconfigMichael Matloob
This change creates a new package that does config initialization and other GCP-specific operations that were previously done in package config, so that config can have no cloud dependencies. For golang/go#61399 Change-Id: I8d78294834e325b47d838892a1cef87003a4b90a Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/522516 Run-TryBot: Michael Matloob <matloob@golang.org> TryBot-Result: Gopher Robot <gobot@golang.org> Reviewed-by: Robert Findley <rfindley@google.com> kokoro-CI: kokoro <noreply+kokoro@google.com>
2023-08-24internal/worker: filter index entries for invalid versionsJamal Carvalho
A bug in the module proxy caused an entries in the index to contain empty version information breaking the pkgsite worker polling job. This change filters out index entries with invalid version information and logs the entry as a warning. Change-Id: I221100d7b26fcd7a17cb87968bb9d7c1c843a0bb Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/522183 TryBot-Result: Gopher Robot <gobot@golang.org> Reviewed-by: Robert Findley <rfindley@google.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Run-TryBot: Jamal Carvalho <jamal@golang.org>
2023-08-24internal/worker: add verbose logging to /poll to diagnose failuresRob Findley
Change-Id: I89c4c20ec23d2de4e46734e0eb70d70eae5dc3cc Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/522241 Run-TryBot: Robert Findley <rfindley@google.com> kokoro-CI: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org> TryBot-Result: Gopher Robot <gobot@golang.org>
2023-08-04internal/frontend: remove dependency on cloud error reporting clientMichael Matloob
This removes the dependency of internal/frontend on the cloud error reporting client, both directly, and through the derrors package by introducing a new interface Reporter that is used both to set the reporting client for internal/derrors, and on the Server. For golang/go#61399 Change-Id: Id4d4def522cda9b4e49f53cff6708019dec2693c Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/514676 Reviewed-by: Jamal Carvalho <jamal@golang.org> kokoro-CI: kokoro <noreply+kokoro@google.com> TryBot-Result: Gopher Robot <gobot@golang.org> Run-TryBot: Michael Matloob <matloob@golang.org>
2023-05-04internal/worker: allow worker to process dynamic excluded prefix filesJamal Carvalho
For golang/go#59622. Change-Id: I4059df405e248824a3521fcc084568b052fe4380 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/486458 Reviewed-by: Suzy Mueller <suzmue@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Robert Findley <rfindley@google.com> Run-TryBot: Jamal Carvalho <jamal@golang.org>
2023-04-14internal/worker: proxy timeouts should be retryableRob Findley
When fetching e.g. the master branch, it is common for the proxy client to timeout as it waits for the branch to be resolved. This should be a retryable error, as otherwise we end up in a state where an asynchronous refresh of master actually breaks documentation at master. There is still a problem that documentation is broken after the first failure, but this at least puts us in a recoverable state. Again, as with CL 482162 this is unfortunately not possible to test in the current setup without significant refactoring. Such refactoring may be warranted, but I do not have time to do this now. Updates golang/go#59464 Change-Id: I321cc2eaabac1d7e052d07efcaadefcac24208ac Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/484736 Reviewed-by: Jamal Carvalho <jamal@golang.org> Run-TryBot: Robert Findley <rfindley@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com>
2022-11-15all: convert interface{} to anyHana (Hyang-Ah) Kim
Change-Id: I1f3b7cc8899c7707abb01e3d14807c37c3451382 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/449695 TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org> Run-TryBot: Hyang-Ah Hana Kim <hyangah@gmail.com>
2022-04-11all: gofmtRuss Cox
Gofmt to update doc comments to the new formatting. For golang/go#51082. Change-Id: Ia9e71e7ecac75822ff43d6c7e60f512442a5fa50 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/399617 Run-TryBot: Russ Cox <rsc@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Auto-Submit: Russ Cox <rsc@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2022-01-06cmd,internal: add worker endpoint to clear beta cacheJamal Carvalho
Added an endpoint to clear the cache during cloudbuild deployments of the beta frontend. Change-Id: I3fb19c3f1eef6b1b15eda2601b27a403b39b0f8d Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/375956 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-11-01internal/worker: update static worker pathJamal Carvalho
CL 359395 updated dochtml.LoadTemplates to expect a static path relative to /doc. This CL updates the path to fix the worker. Change-Id: If1562e786112f5d00daa6d083ed24709499d1bce Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/360434 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-10-28many: cmd/pkgsite embeds static assetsJonathan Amsterdam
The `pkgsite` command now embeds all the static assets it needs, so it need not be told the location of the static/ directory with a flag. The binary is self-contained and can be placed and invoked from anywhere. This required embedding the static/ and third_party/ directories. Since //go:embed cannot reference files outside the containing package's tree, we had to add trivial Go packages in static/ and third_party/ to construct `embed.FS`s for those directories. Also, the frontend needed to accept `fs.FS` values where it previously took paths, and `template.TrustedFS` values where it previously used `template.TrustedSources`. We ended up clumsily requiring four separate config values: - A TrustedFS to load templates. - Two fs.FSs, one for static and one for third_party, to load other assets. - The path to the static directory as a string, solely to support dynamic loading in dev mode. For golang/go#48410 Change-Id: I9eeb351b1c6f23444b9e65b60f2a1d3905d59ef9 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/359395 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-09-14internal/{worker,stdlib}: /fetch-std-master: avoid cloning go repoJonathan Amsterdam
On each call of the /fetch-std-master endpoint, we cloned the Go repo for each supported branch to determine its current commit. Although not a big deal, that is a bit wasteful and it also would occasionally fail obscurely. Instead we use git's remote list feature to get all the repo's refs in one call. We then compare the hashes with the stored pseudo-versions to see if the branch has moved. Change-Id: I1d70e63668fcf6d35b90b9c231255faec614a04e Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/349753 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-09-14internal/worker: avoid redirect for /fetch-std-masterJonathan Amsterdam
The final slash in the registered URL results in an unnecessary 301 on every request. Change-Id: I4eee8ba087615f8e20546f4afc31d182c1db6cb8 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/349750 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-09-14internal/{queue,worker}: add worker source paramJulie Qiu
When a request is enqueued via the /enqueue endpoint, add a source=worker query param so that it is clear from the logs where this request came from. Change-Id: I396bb8a952640c244e0b217e48356e8088ed5eb0 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/349530 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-09-13internal: add frontend fetch sourceJulie Qiu
Frontend fetch requests now have a source=fetch query param. This query param will be used in the next CL to update module_version_states correctly. Change-Id: I658ccea9fba7583838f8ccf733e2862966aef86d Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/348816 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com>
2021-09-13internal/worker: move load shedder into serverJonathan Amsterdam
This will enable using DB metrics for load shedding. For golang/go#48010 Change-Id: Ie61da82e833d376d36f74c55266a11346855c5ff Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/349311 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org> Reviewed-by: Julie Qiu <julie@golang.org>
2021-09-13{cmd,internal}/worker: export DB info metricsJonathan Amsterdam
Add metrics for the numbers of active and waiting DB processes. For golang/go#48010 Change-Id: Ia3c14e492b29c07371ee903182c7ba55f04c584a Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/349310 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org> Reviewed-by: Julie Qiu <julie@golang.org>
2021-09-13internal/worker: display DB info on home pageJonathan Amsterdam
Add DB process and lock information to the worker home page. For golang/go#48010 Change-Id: Idab82180a33ce2d00350df0bbfeeb58b2a628ae8 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/349309 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org> Reviewed-by: Julie Qiu <julie@golang.org>
2021-09-13internal/worker: schedule fetch of std branch on not foundJonathan Amsterdam
The worker handler that schedules fetches of supported stdlib branches has been failing when the version_map table doesn't have the branch. Schedule a fetch in that case instead, because it indicates that we need to fetch the branch for the first time. Change-Id: Ic9b2faff1bd50f9b22d2601eabf6feb3b394e95f Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/349050 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> Reviewed-by: Julie Qiu <julie@golang.org> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-09-13internal/queue: add OptionsJulie Qiu
queue.Options is now used to pass optional arguments to ScheduleFetch. Change-Id: I4e00a91ad7d2cfa2ccf669d643a21fda6b3b3fb8 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/348815 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-09-03internal/worker: add loadshedder to fetch testJonathan Amsterdam
Test fetching with an actual loadshedder. This will catch bugs like the one fixed by https://golang.org/cl/347109. Change-Id: I75de9eb22110466ddae8e9c7378844a68322c6c2 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/347395 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-09-01internal/proxy: cache info and mod endpointsJonathan Amsterdam
Add more caching to the proxy client so we can call Info and Mod multiple times during a fetch without worrying about wasted RPCs to the proxy. This will enable moving the load shedder, which requires its own info call, out of the fetch logic and into the worker. For golang/go#48010 Change-Id: I4e875b1fd5b968aae174cfb93f4cf3a9a2b7a577 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/346729 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-08-23internal/{fetch,worker,stdlib}: remove stdlib.ZipJonathan Amsterdam
For golang/go#47834 Change-Id: I81acf4fdc51a19352bfa7fb0cf9a2c22bb42a65b Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/343966 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-08-17internal/postgres: rename CleanModule to CleanAllModuleVersionsJulie Qiu
We use the term Module to mean ModuleVersion in the pkgsite codebase, (for example, DeleteModule means delete a specific module version), so CleanModule is renamed to CleanAllModuleVersions for clarity. Change-Id: I45553067b84cb12b8ae03a32fb96da10c642a15b Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/342892 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-08-06all: delete redis HA clientsJulie Qiu
The redis HA was used by search autocomplete and is no longer used by anything. Change-Id: I39a2c81c47da53823d7b668a980159c4726c6b13 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/340393 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-16internal/worker: remove delete from fetch-std-masterJulie Qiu
The delete statement in fetch-std-master always deleting either the last version @master or @dev.fuzz. This isn't needed, since we have a /clean endpoint, so remove it. Change-Id: I570676ffeeec034a1677e1ecbd5f826f09fb6cd5 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/334952 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-07-13internal/postgres: reprocess modules in search_documentsJulie Qiu
An endpoint is added to the worker, which only reprocess modules that are in the search_documents table. For golang/go#44142 Change-Id: I46e1e457707f3010ea2ea42c8aac60adbf3e8fd7 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/332190 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-12internal/worker: poll for std@dev.fuzz versionsJulie Qiu
In addition to polling to refresh std@master, we also poll for std@dev.fuzz. For golang/go#46910 Change-Id: Id376b2a4100f8677e1e0bba1069a32972a156910 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/330414 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-07-12internal/worker: support frontend URL syntax in /fetch endpointJulie Qiu
The /fetch endpoint now supports the pkg.go.dev frontend URL syntax (in addition to the proxy URL syntax). It is useful to be able to make a fetch request from the worker just by changing the hostname during development. Change-Id: Ib2f1e35c5b1aae52cc8254c46d9bfbf051605988 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/333831 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-06-14internal/worker: move worker faviconJonathan Amsterdam
Move the worker favicon into static/worker. Change-Id: I36e22b6c5b641cf625c5949f08c3d44bd95ee6d6 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/327669 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-06-12internal: switch static reads from content/static to staticJamal Carvalho
Change-Id: Icec167d645b9178375b959491206277e13b455cf Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/327283 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-06-09internal/worker: add metric for new unprocessed modulesJonathan Amsterdam
We have a metric for total unprocessed modules, including new ones and those we are reprocessing. Add a metric that tracks only the new ones: those with status 0 or 500 (the latter to count the number of failed new modules). This metric is a better choice for an alert, since during reprocessing we expect a very large total backlog, but we never want a large backlog of new modules. Change-Id: Ibc3cbee1d867f6a454748237352a70cf9eb500c0 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/326290 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-06-09internal: update references to dochtmlJamal Carvalho
Change-Id: I853d07d59330cd9d86361167449862f3a4d4a7de Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/326057 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> Reviewed-by: Jonathan Amsterdam <jba@google.com>
2021-06-09content,internal: move worker UI code to worker directoryJamal Carvalho
The html,css, and js directories in content/static now contain only legacy code. Updating the worker look for static assets in content/static/worker. Change-Id: I94d38c711badeb60a4b80cdf25e1aaf4e8de6adc Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/325852 Trust: Jamal Carvalho <jamal@golang.org> Run-TryBot: Jamal Carvalho <jamal@golang.org> Reviewed-by: Julie Qiu <julie@golang.org>
2021-06-07internal/version: drop Version suffix from constantsJulie Qiu
To avoid repetition, the "Version" suffix in version.LatestVersion, version.MainVersion, and version.MasterVersion are dropped. The current version.Latest function is renamed to version.LatestVersion. Change-Id: I649229939223b686dd95a137df4871a899f48aab Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/325390 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-06-07internal: move version constants to internal/versionJulie Qiu
Because the constants for "latest", "master" and "main" were in package internal, we couldn't use them in internal/stdlib due to an import cycle. They are now moved to internal/version to avoid this cycle. Change-Id: I6ebe7c0f50037be2b047c4a25054a0531dcfd3f8 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/325389 Trust: Julie Qiu <julie@golang.org> Run-TryBot: Julie Qiu <julie@golang.org> Reviewed-by: Jamal Carvalho <jamal@golang.org>
2021-05-27internal/{postgres,worker}: add metric for number unprocessedJonathan Amsterdam
Add a metric that records how many modules need to be processed (those with status codes of 0 or 5xx). That will tell us how much the worker is backed up. Change-Id: I68c47255e3720b5f978037c1251b0e502961d089 Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/323109 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
2021-05-01internal/worker: /clean endpoint supports a single moduleJonathan Amsterdam
The /clean endpoint can be used to clean all versions of a given module. For golang/go#45852 Change-Id: Ie39d142c9c1049213eb5319d31196d77e3b7052f Reviewed-on: https://go-review.googlesource.com/c/pkgsite/+/315829 Trust: Jonathan Amsterdam <jba@google.com> Run-TryBot: Jonathan Amsterdam <jba@google.com> TryBot-Result: kokoro <noreply+kokoro@google.com> Reviewed-by: Julie Qiu <julie@golang.org>
generated by cgit v1.3 (git 2.53.0) at 2026-04-15 06:14:09 +0000