crypto/tls: advertise and accept rsa_pss_rsae signature algorithms

crypto/x509 already supports PSS signatures (with rsaEncryption OID),
and crypto/tls support was added in CL 79736. Advertise support for the
algorithms and accept them as a peer.

Note that this is about PSS signatures from regular RSA public keys.
RSA-PSS only public keys (with RSASSA-PSS OID) are supported in neither
crypto/tls nor crypto/x509. See RFC 8446, Section 4.2.3.

testdata/Server-TLSv12-ClientAuthRequested* got modified because the
CertificateRequest carries the supported signature algorithms.

The net/smtp tests changed because 512 bits keys are too small for PSS.

Based on Peter Wu's CL 79738, who did all the actual work in CL 79736.

Updates #9671

Change-Id: I4a31e9c6e152ff4c50a5c8a274edd610d5fff231
Reviewed-on: https://go-review.googlesource.com/c/146258
Run-TryBot: Filippo Valsorda <filippo@golang.org>
TryBot-Result: Gobot Gobot <gobot@golang.org>
Reviewed-by: Adam Langley <agl@golang.org>

1 files changed, 44 insertions, 43 deletions

diff --git a/src/crypto/tls/testdata/Server-TLSv12-ClientAuthRequestedAndGiven b/src/crypto/tls/testdata/Server-TLSv12-ClientAuthRequestedAndGiven
index aa4cfe1261..3587dbed6c 100644
--- a/src/crypto/tls/testdata/Server-TLSv12-ClientAuthRequestedAndGiven
+++ b/src/crypto/tls/testdata/Server-TLSv12-ClientAuthRequestedAndGiven
@@ -1,11 +1,11 @@
 >>> Flow 1 (client to server)
-00000000  16 03 01 00 5d 01 00 00  59 03 03 ed f9 4a 41 31  |....]...Y....JA1|
-00000010  20 6a df af 85 92 37 a1  38 81 ed 3c 1a 7e d2 31  | j....7.8..<.~.1|
-00000020  80 5b 68 87 b6 72 43 8e  c0 f0 dd 00 00 04 00 2f  |.[h..rC......../|
-00000030  00 ff 01 00 00 2c 00 0d  00 20 00 1e 06 01 06 02  |.....,... ......|
-00000040  06 03 05 01 05 02 05 03  04 01 04 02 04 03 03 01  |................|
-00000050  03 02 03 03 02 01 02 02  02 03 00 16 00 00 00 17  |................|
-00000060  00 00                                             |..|
+00000000  16 03 01 00 6b 01 00 00  67 03 03 47 66 fd 67 73  |....k...g..Gf.gs|
+00000010  ca ca cb c2 64 5f aa 0f  93 f1 0e 82 d8 3d 84 bb  |....d_.......=..|
+00000020  c1 7e 31 e2 39 ae 63 e9  ef 40 13 00 00 04 00 2f  |.~1.9.c..@...../|
+00000030  00 ff 01 00 00 3a 00 00  00 0e 00 0c 00 00 09 31  |.....:.........1|
+00000040  32 37 2e 30 2e 30 2e 31  00 0b 00 04 03 00 01 02  |27.0.0.1........|
+00000050  00 0a 00 0c 00 0a 00 1d  00 17 00 1e 00 19 00 18  |................|
+00000060  00 16 00 00 00 17 00 00  00 0d 00 04 00 02 08 04  |................|
 >>> Flow 2 (server to client)
 00000000  16 03 03 00 31 02 00 00  2d 03 03 00 00 00 00 00  |....1...-.......|
 00000010  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
@@ -48,9 +48,10 @@
 00000260  f1 6c 04 ed 73 bb b3 43  77 8d 0c 1c f1 0f a1 d8  |.l..s..Cw.......|
 00000270  40 83 61 c9 4c 72 2b 9d  ae db 46 06 06 4d f4 c1  |@.a.Lr+...F..M..|
 00000280  b3 3e c0 d1 bd 42 d4 db  fe 3d 13 60 84 5c 21 d3  |.>...B...=.`.\!.|
-00000290  3b e9 fa e7 16 03 03 00  1b 0d 00 00 17 02 01 40  |;..............@|
-000002a0  00 10 04 01 04 03 05 01  05 03 06 01 06 03 02 01  |................|
-000002b0  02 03 00 00 16 03 03 00  04 0e 00 00 00           |.............|
+00000290  3b e9 fa e7 16 03 03 00  21 0d 00 00 1d 02 01 40  |;.......!......@|
+000002a0  00 16 08 04 08 05 08 06  04 01 04 03 05 01 05 03  |................|
+000002b0  06 01 06 03 02 01 02 03  00 00 16 03 03 00 04 0e  |................|
+000002c0  00 00 00                                          |...|
 >>> Flow 3 (client to server)
 00000000  16 03 03 01 fd 0b 00 01  f9 00 01 f6 00 01 f3 30  |...............0|
 00000010  82 01 ef 30 82 01 58 a0  03 02 01 02 02 10 5c 19  |...0..X.......\.|
@@ -84,40 +85,40 @@
 000001d0  ac 11 b1 28 56 be 1d cd  61 62 84 09 bf d6 80 c6  |...(V...ab......|
 000001e0  45 8d 82 2c b4 d8 83 9b  db c9 22 b7 2a 12 11 7b  |E..,......".*..{|
 000001f0  fa 02 3b c1 c9 ff ea c9  9d a8 49 d3 95 d7 d5 0e  |..;.......I.....|
-00000200  e5 35 16 03 03 00 86 10  00 00 82 00 80 90 96 a6  |.5..............|
-00000210  45 0a 8d 6a 38 86 3a f0  0a cb d6 bb db 9b 27 a6  |E..j8.:.......'.|
-00000220  17 ca 02 6d 67 3c 56 80  74 9b 06 6e 62 58 55 43  |...mg<V.t..nbXUC|
-00000230  7e 7d 08 be cb 46 c4 60  45 e5 1c 3c 7d 89 bd 0d  |~}...F.`E..<}...|
-00000240  c1 0a 7f d9 7c c2 c1 c6  c5 62 83 9e 88 a3 20 1c  |....|....b.... .|
-00000250  d5 d6 32 b5 f8 4a 44 d5  35 e5 45 c1 68 c3 99 d3  |..2..JD.5.E.h...|
-00000260  f3 7b 0b 46 0a 8d 02 81  ca bb 0c ce b1 53 f0 0a  |.{.F.........S..|
-00000270  10 b6 92 b3 b9 2a d5 8d  9d 68 94 54 11 37 69 12  |.....*...h.T.7i.|
-00000280  54 21 8a 95 a2 72 a8 1c  1a 21 74 9c 6f 16 03 03  |T!...r...!t.o...|
-00000290  00 88 0f 00 00 84 04 01  00 80 b9 cf 9f 51 c7 0b  |.............Q..|
-000002a0  5c b0 2f ce 33 b0 d9 b6  c6 ae 47 29 09 8c 44 51  |\./.3.....G)..DQ|
-000002b0  40 86 04 66 d2 13 ff 22  f4 97 c6 c2 a0 1f 98 8e  |@..f..."........|
-000002c0  a6 6e 9f 61 b1 fe ce 0d  82 43 42 06 9b 47 09 48  |.n.a.....CB..G.H|
-000002d0  a4 94 40 9f d3 2c 0f 22  f8 01 53 f0 a7 2a fd 86  |..@..,."..S..*..|
-000002e0  0b a2 b8 d7 b0 ee 0c a8  b7 c8 61 80 85 28 73 0b  |..........a..(s.|
-000002f0  c0 8f 8a 2c 53 cc 2c 8a  5b 72 5a a6 9e 66 ea 96  |...,S.,.[rZ..f..|
-00000300  7d e2 14 47 7e 17 a9 2b  d7 27 ca f7 21 ff 28 57  |}..G~..+.'..!.(W|
-00000310  fa 20 88 99 db 4f 91 0a  be 07 14 03 03 00 01 01  |. ...O..........|
-00000320  16 03 03 00 40 af 85 82  66 bd 2c 4b c8 17 4c d8  |....@...f.,K..L.|
-00000330  69 6d 62 37 88 70 cf b2  31 f5 46 90 a6 fa ac 3d  |imb7.p..1.F....=|
-00000340  02 1e 74 bb 24 83 35 34  ed 3f 7c ba d9 03 e1 4a  |..t.$.54.?|....J|
-00000350  cf d5 16 aa 56 47 47 27  0e 68 de 12 bd 56 6e df  |....VGG'.h...Vn.|
-00000360  fc 7e f1 34 ad                                    |.~.4.|
+00000200  e5 35 16 03 03 00 86 10  00 00 82 00 80 6f 78 9e  |.5...........ox.|
+00000210  61 7a 8a 81 b2 fb 64 12  df 19 a0 fe 51 4f 9f cc  |az....d.....QO..|
+00000220  a5 11 94 21 64 1f 35 55  9c d4 5a cd 09 3c cc 09  |...!d.5U..Z..<..|
+00000230  f3 bf e8 4f 22 18 9a a2  32 54 dc 33 aa 64 c5 28  |...O"...2T.3.d.(|
+00000240  46 6b 04 7f 00 a5 38 47  f2 73 cc c6 bf 86 a7 5c  |Fk....8G.s.....\|
+00000250  b5 15 f9 b7 29 29 47 19  4e ba 95 4c dd 34 47 45  |....))G.N..L.4GE|
+00000260  fe e6 f2 49 7a 47 59 32  8f 82 0c fc 74 e8 65 3b  |...IzGY2....t.e;|
+00000270  89 cc eb 17 d6 7b 54 a1  39 14 3c 07 89 9d 16 56  |.....{T.9.<....V|
+00000280  3e 5a 13 74 31 83 2e 43  77 c2 4e eb 43 16 03 03  |>Z.t1..Cw.N.C...|
+00000290  00 88 0f 00 00 84 08 04  00 80 16 fb 7d 3e 8e 60  |............}>.`|
+000002a0  00 c6 18 1c 4f 3e 3d 46  48 f9 ed f7 a9 74 91 17  |....O>=FH....t..|
+000002b0  49 0f 57 be 34 45 56 ef  25 90 54 8e a2 b5 fc 7a  |I.W.4EV.%.T....z|
+000002c0  62 6f c1 fc e4 b8 88 49  61 4c da 38 91 a8 45 a6  |bo.....IaL.8..E.|
+000002d0  d5 3a bd c6 a5 6e f5 ab  5c d6 1a eb 0b df 7c e2  |.:...n..\.....|.|
+000002e0  77 43 35 85 6a 91 f9 7e  20 85 5c e2 5e 95 4c b9  |wC5.j..~ .\.^.L.|
+000002f0  82 d7 58 a4 c1 dc 48 f9  37 0c 81 09 b4 da 8b 36  |..X...H.7......6|
+00000300  06 7f 73 c1 16 2d 33 e6  4a 7d 16 b2 c5 af ce 76  |..s..-3.J}.....v|
+00000310  8f 9a 7e 7f 1b 2a 2c d2  60 01 14 03 03 00 01 01  |..~..*,.`.......|
+00000320  16 03 03 00 40 63 f7 3c  b7 a5 b0 97 98 3a 53 c1  |....@c.<.....:S.|
+00000330  1f f5 f9 a1 1a 2f 30 4d  99 be 36 51 0a b3 49 8e  |...../0M..6Q..I.|
+00000340  8d 24 ed 6f 37 11 69 f9  86 58 5e f8 1d e1 4a f4  |.$.o7.i..X^...J.|
+00000350  2c 46 24 ed 72 a3 09 53  5e 8c 3c ea dc 3a c0 ea  |,F$.r..S^.<..:..|
+00000360  f3 19 c5 27 ff                                    |...'.|
 >>> Flow 4 (server to client)
 00000000  14 03 03 00 01 01 16 03  03 00 40 00 00 00 00 00  |..........@.....|
-00000010  00 00 00 00 00 00 00 00  00 00 00 52 d1 34 99 c9  |...........R.4..|
-00000020  60 18 c3 99 36 2d c5 c2  14 ae f4 e5 10 e1 6f af  |`...6-........o.|
-00000030  70 3b c3 d6 d1 81 ee da  fe 6e a5 96 81 53 cf 9a  |p;.......n...S..|
-00000040  cc c2 ac 98 95 0c 75 81  ac 55 6b 17 03 03 00 40  |......u..Uk....@|
+00000010  00 00 00 00 00 00 00 00  00 00 00 5d d7 d8 ca c3  |...........]....|
+00000020  2e 0a ef e0 5b 27 ec ae  af 3d 40 33 17 69 73 2d  |....['...=@3.is-|
+00000030  86 4c cc c8 63 cd 00 eb  9e 82 96 d7 07 e6 bd 8e  |.L..c...........|
+00000040  bb 60 59 d2 54 20 eb c3  c1 12 e3 17 03 03 00 40  |.`Y.T .........@|
 00000050  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
-00000060  46 ff 8d a9 0d 65 e1 82  48 4c 31 ec 60 24 61 52  |F....e..HL1.`$aR|
-00000070  33 41 b1 7b 6a a8 96 b3  59 eb c9 2c f8 f2 4d 15  |3A.{j...Y..,..M.|
-00000080  83 3e 99 c4 08 89 24 e3  de 4a bf 54 f4 eb a3 2a  |.>....$..J.T...*|
+00000060  66 76 a3 75 1a 79 7a 21  e9 da 94 77 7f 6d ac 4a  |fv.u.yz!...w.m.J|
+00000070  b3 b1 e1 e4 93 7d 71 20  09 bd cf bc f1 71 7a c3  |.....}q .....qz.|
+00000080  50 ec 2a af 02 28 c4 45  e9 a8 cd 12 17 36 13 6c  |P.*..(.E.....6.l|
 00000090  15 03 03 00 30 00 00 00  00 00 00 00 00 00 00 00  |....0...........|
-000000a0  00 00 00 00 00 dc f3 c7  14 24 b7 a8 fa f4 78 6f  |.........$....xo|
-000000b0  7a 0c bd ad 14 d5 83 f7  97 30 58 0a a8 b5 76 88  |z........0X...v.|
-000000c0  60 00 3d 4c 1a                                    |`.=L.|
+000000a0  00 00 00 00 00 f8 bd d2  f8 ce ae bc d9 11 2c fb  |..............,.|
+000000b0  23 69 5d 9b dd 5d 8a 25  9c 87 c4 29 0d 07 7f a3  |#i]..].%...)....|
+000000c0  4d 32 0a fa 33                                    |M2..3|