Scrapy SSL routines', 'tls_process_ske_dhe', 'dh key too small' after upgrade scrapy version

 上网找到, 

https://github.com/scrapy/scrapy/issues/3392
但設定完都不成, 好像那個website TLS.1.2 反而沒事. 

 

from twisted.internet.ssl import AcceptableCiphers

class CustomContextFactory(ScrapyClientContextFactory):
        def __init__(self,method,tls_verbose_logging, tls_ciphers):
    
        self.tls_ciphers = AcceptableCiphers.fromOpenSSLCipherString('DEFAULT:!DH')
        self.method = 6 # original want to "TLS1.2 but error ...“ https://github.com/pyca/pyopenssl/blob/master/src/OpenSSL/SSL.py
        self.tls_verbose_logging= False
     

 

之後在setting.py 加一行, 之前以為在downloadmiddleware 加, 但原來不是.