ϪfKldZddlmZmZmZmZddlmZmZddl m Z ddl m Z ddl mZddlmZerddlmZmZGd d eZGd d eZGd deZGddeZGddeZGddeZGddeZGddeZGddeZGddeZGddeZGdd eZGd!d"eZ Gd#d$eZ!d%Z"gd&Z#y')(z Interface definitions for L{twisted.web}. @var UNKNOWN_LENGTH: An opaque object which may be used as the value of L{IBodyProducer.length} to indicate that the length of the entity body is not known in advance. ) TYPE_CHECKINGCallableListOptional) Attribute Interface)IUsernameDigestHash)Deferred) IPushProducer)Headers) FlattenableTagcDeZdZdZedZedZedZedZedZ edZ edZ ed Z ed Z d Zd Zd ZdZdZdZdZdZdZdZd$dZdZdZdZdZdZdZ d%dZd$dZ dZ!d Z"d!Z#d"Z$d&d#Z%y)'IRequestz+ An HTTP request. @since: 9.0 z0A L{bytes} giving the HTTP method that was used.zWA L{bytes} giving the full encoded URI which was requested (including query arguments).z\A L{bytes} giving the encoded query path of the request URI (not including query arguments).aA mapping of decoded query argument names as L{bytes} to corresponding query argument values as L{list}s of L{bytes}. For example, for a URI with C{foo=bar&foo=baz&quux=spam} for its query part, C{args} will be C{{b'foo': [b'bar', b'baz'], b'quux': [b'spam']}}.zaThe URL path segments which have been processed during resource traversal, as a list of L{bytes}.zkThe URL path segments which have not (yet) been processed during resource traversal, as a list of L{bytes}.zLA L{http_headers.Headers} instance giving all received HTTP request headers.zA file-like object giving the request body. This may be a file on disk, an L{io.BytesIO}, or some other type. The implementation is free to decide on a per-request basis.zPA L{http_headers.Headers} instance holding all HTTP response headers to be sent.cy)a Get an HTTP request header. @type key: L{bytes} or L{str} @param key: The name of the header to get the value of. @rtype: L{bytes} or L{str} or L{None} @return: The value of the specified header, or L{None} if that header was not present in the request. The string type of the result matches the type of C{key}. Nkeys 2/usr/lib/python3/dist-packages/twisted/web/iweb.py getHeaderzIRequest.getHeaderKcy)a. Get a cookie that was sent from the network. @type key: L{bytes} @param key: The name of the cookie to get. @rtype: L{bytes} or L{None} @returns: The value of the specified cookie, or L{None} if that cookie was not present in the request. Nrrs r getCookiezIRequest.getCookieXrrcy)z Return dictionary mapping the names of all received headers to the last value received for each. Since this method does not return all header information, C{requestHeaders.getAllRawHeaders()} may be preferred. Nrrrr getAllHeaderszIRequest.getAllHeadersdrrcy)a Get the hostname that the HTTP client passed in to the request. This will either use the C{Host:} header (if it is available; which, for a spec-compliant request, it will be) or the IP address of the host we are listening on if the header is unavailable. @note: This is the I{host portion} of the requested resource, which means that: 1. it might be an IPv4 or IPv6 address, not just a DNS host name, 2. there's no guarantee it's even a I{valid} host name or IP address, since the C{Host:} header may be malformed, 3. it does not include the port number. @returns: the requested hostname @rtype: L{bytes} NrrrrgetRequestHostnamezIRequest.getRequestHostnamemrrcy)z Get my originally requesting transport's host. @return: An L{IAddress}. NrrrrgetHostzIRequest.getHostrrcy)a Return the address of the client who submitted this request. The address may not be a network address. Callers must check its type before using it. @since: 18.4 @return: the client's address. @rtype: an L{IAddress} provider. NrrrrgetClientAddresszIRequest.getClientAddressrrcy)aP Return the IP address of the client who submitted this request. This method is B{deprecated}. See L{getClientAddress} instead. @returns: the client IP address or L{None} if the request was submitted over a transport where IP addresses do not make sense. @rtype: L{str} or L{None} Nrrrr getClientIPzIRequest.getClientIPrrcy)z Return the HTTP user sent with this request, if any. If no user was supplied, return the empty string. @returns: the HTTP user, if any @rtype: L{str} NrrrrgetUserzIRequest.getUserrrcy)z Return the HTTP password sent with this request, if any. If no password was supplied, return the empty string. @returns: the HTTP password, if any @rtype: L{str} Nrrrr getPasswordzIRequest.getPasswordrrcy)az Return True if this request is using a secure transport. Normally this method returns True if this request's HTTPChannel instance is using a transport that implements ISSLTransport. This will also return True if setHost() has been called with ssl=True. @returns: True if this request is secure @rtype: C{bool} NrrrrisSecurezIRequest.isSecurerrNcy)a@ Look up the session associated with this request or create a new one if there is not one. @return: The L{Session} instance identified by the session cookie in the request, or the C{sessionInterface} component of that session if C{sessionInterface} is specified. Nr)sessionInterfaces r getSessionzIRequest.getSessionrrcy)z @return: A L{URLPath} instance which identifies the URL for which this request is. NrrrrURLPathzIRequest.URLPathrrcy)a At any time during resource traversal or resource rendering, returns an absolute URL to the most nested resource which has yet been reached. @see: {twisted.web.server.Request.prepath} @return: An absolute URL. @rtype: L{bytes} Nrrrr prePathURLzIRequest.prePathURLrrcy)z_ Remember the currently-processed part of the URL for later recalling. NrrrrrememberRootURLzIRequest.rememberRootURLrrcy)zn Get a previously-remembered URL. @return: An absolute URL. @rtype: L{bytes} Nrrrr getRootURLzIRequest.getRootURLrrcy)zI Indicate that the response to this request is complete. NrrrrfinishzIRequest.finishrrcy)a$ Write some data to the body of the response to this request. Response headers are written the first time this method is called, after which new response headers may not be added. @param data: Bytes of the response body. @type data: L{bytes} Nrdatas rwritezIRequest.writerrcy)z Set an outgoing HTTP cookie. In general, you should consider using sessions instead of cookies, see L{twisted.web.server.Request.getSession} and the L{twisted.web.server.Session} class for details. Nr)kvexpiresdomainpathmax_agecommentsecures r addCookiezIRequest.addCookierrcy)zi Set the HTTP response code. @type code: L{int} @type message: L{bytes} Nr)codemessages rsetResponseCodezIRequest.setResponseCoderrcy)a Set an HTTP response header. Overrides any previously set values for this header. @type k: L{bytes} or L{str} @param k: The name of the header for which to set the value. @type v: L{bytes} or L{str} @param v: The value to set for the named header. A L{str} will be UTF-8 encoded, which may not interoperable with other implementations. Avoid passing non-ASCII characters if possible. Nr)r=r>s r setHeaderzIRequest.setHeaderrrcy)zu Utility function that does a redirect. The request should have finish() called after this. Nr)urls rredirectzIRequest.redirect(rrcy)a9 Set the C{Last-Modified} time for the response to this request. If I am called more than once, I ignore attempts to set Last-Modified earlier, only replacing the Last-Modified time if it is to a later value. If I am a conditional request, I may modify my response code to L{NOT_MODIFIED} if appropriate for the time given. @param when: The last time the resource being returned was modified, in seconds since the epoch. @type when: L{int} or L{float} @return: If I am a C{If-Modified-Since} conditional request and the time given is not newer than the condition, I return L{CACHED} to indicate that you should write no body. Otherwise, I return a false value. Nr)whens rsetLastModifiedzIRequest.setLastModified/rrcy)a  Set an C{entity tag} for the outgoing response. That's "entity tag" as in the HTTP/1.1 I{ETag} header, "used for comparing two or more entities from the same requested resource." If I am a conditional request, I may modify my response code to L{NOT_MODIFIED} or L{PRECONDITION_FAILED}, if appropriate for the tag given. @param etag: The entity tag for the resource being returned. @type etag: L{str} @return: If I am a C{If-None-Match} conditional request and the tag matches one in the request, I return L{CACHED} to indicate that you should write no body. Otherwise, I return a false value. Nr)etags rsetETagzIRequest.setETagDrrcy)a Change the host and port the request thinks it's using. This method is useful for working with reverse HTTP proxies (e.g. both Squid and Apache's mod_proxy can do this), when the address the HTTP client is using is different than the one we're listening on. For example, Apache may be listening on https://www.example.com, and then forwarding requests to http://localhost:8080, but we don't want HTML produced by Twisted to say 'http://localhost:8080', they should say 'https://www.example.com', so we do:: request.setHost('www.example.com', 443, ssl=1) Nr)hostportssls rsetHostzIRequest.setHostYrr)N)NNNNNN)r)&__name__ __module__ __qualname____doc__rmethodurirAargsprepathpostpathrequestHeaderscontentresponseHeadersrrrrr r"r$r&r(r*r-r/r1r3r5r7r;rErIrKrNrQrTrYrrrrrs& I JF   C  & D   D ,G  <H  N  1G   O      0                  $     * * rrceZdZdZdZy)INonQueuedRequestFactoryzU A factory of L{IRequest} objects that does not take a ``queued`` parameter. cy)an Create an L{IRequest} that is operating on the given channel. There must only be one L{IRequest} object processing at any given time on a channel. @param channel: A L{twisted.web.http.HTTPChannel} object. @type channel: L{twisted.web.http.HTTPChannel} @return: A request object. @rtype: L{IRequest} Nr)channels r__call__z!INonQueuedRequestFactory.__call__orrNrZr[r\r]rjrrrrgrgjs   rrgceZdZdZdZy)IAccessLogFormatterzr An object which can represent an HTTP request as a line of text for inclusion in an access log file. cy)a Generate a line for the access log. @param timestamp: The time at which the request was completed in the standard format for access logs. @type timestamp: L{unicode} @param request: The request object about which to log. @type request: L{twisted.web.server.Request} @return: One line describing the request without a trailing newline. @rtype: L{unicode} Nr) timestamprequests rrjzIAccessLogFormatter.__call__rrNrkrrrrmrm}s   rrmc,eZdZdZedZdZdZy)ICredentialFactoryai A credential factory defines a way to generate a particular kind of authentication challenge and a way to interpret the responses to these challenges. It creates L{ICredentials} providers from responses. These objects will be used with L{twisted.cred} to authenticate an authorize requests. zA L{str} giving the name of the authentication scheme with which this factory is associated. For example, C{'basic'} or C{'digest'}.cy)aW Generate a new challenge to be sent to a client. @type request: L{twisted.web.http.Request} @param request: The request the response to which this challenge will be included. @rtype: L{dict} @return: A mapping from L{str} challenge fields to associated L{str} values. Nrrps r getChallengezICredentialFactory.getChallengerrcy)a  Create a credentials object from the given response. @type response: L{str} @param response: scheme specific response string @type request: L{twisted.web.http.Request} @param request: The request being processed (from which the response was taken). @raise twisted.cred.error.LoginFailed: If the response is invalid. @rtype: L{twisted.cred.credentials.ICredentials} provider @return: The credentials represented by the given response. Nr)responserps rdecodezICredentialFactory.decoderrN)rZr[r\r]rschemerurxrrrrrrrs# OF   rrrc,eZdZdZedZdZdZy) IBodyProducera Objects which provide L{IBodyProducer} write bytes to an object which provides L{IConsumer} by calling its C{write} method repeatedly. L{IBodyProducer} providers may start producing as soon as they have an L{IConsumer} provider. That is, they should not wait for a C{resumeProducing} call to begin writing data. L{IConsumer.unregisterProducer} must not be called. Instead, the L{Deferred} returned from C{startProducing} must be fired when all bytes have been written. L{IConsumer.write} may synchronously invoke any of C{pauseProducing}, C{resumeProducing}, or C{stopProducing}. These methods must be implemented with this in mind. @since: 9.0 z C{length} is a L{int} indicating how many bytes in total this L{IBodyProducer} will write to the consumer or L{UNKNOWN_LENGTH} if this is not known in advance. cy)a Start producing to the given L{IConsumer} provider. @return: A L{Deferred} which stops production of data when L{Deferred.cancel} is called, and which fires with L{None} when all bytes have been produced or with a L{Failure} if there is any problem before all bytes have been produced. Nr)consumers rstartProducingzIBodyProducer.startProducingrrcy)a) In addition to the standard behavior of L{IProducer.stopProducing} (stop producing data), make sure the L{Deferred} returned by C{startProducing} is never fired. Nrrrr stopProducingzIBodyProducer.stopProducingrrN)rZr[r\r]rlengthr~rrrrr{r{s"8 F   rr{cJeZdZdZdedeeedgdffdZdeeddfdZ y ) IRenderablezs An L{IRenderable} is an object that may be rendered by the L{twisted.web.template} templating system. namereturnrr cy)a Look up and return the render method associated with the given name. @param name: The value of a render directive encountered in the document returned by a call to L{IRenderable.render}. @return: A two-argument callable which will be invoked with the request being responded to and the tag object on which the render directive was encountered. Nr)rs rlookupRenderMethodzIRenderable.lookupRenderMethodrrrpcy)z Get the document for this L{IRenderable}. @param request: The request in response to which this method is being invoked. @return: An object which can be flattened. Nrrts rrenderzIRenderable.renderrrN) rZr[r\r]strrrrrrrrrrrsH    8H%u-}< =   * } rrc"eZdZdZdedfdZy)ITemplateLoaderz| A loader for templates; something usable as a value for L{twisted.web.template.Element}'s C{loader} attribute. rr cy)z Load a template suitable for rendering. @return: a L{list} of flattenable objects, such as byte and unicode strings, L{twisted.web.template.Element}s and L{IRenderable} providers. NrrrrloadzITemplateLoader.load!rrN)rZr[r\r]rrrrrrrs  $}% rrceZdZdZedZedZedZedZedZ edZ edZ d Z d Z y ) IResponseza An object representing an HTTP response received from an HTTP server. @since: 11.1 zA three-tuple describing the protocol and protocol version of the response. The first element is of type L{str}, the second and third are of type L{int}. For example, C{(b'HTTP', 1, 1)}.z3The HTTP status code of this response, as a L{int}.z5The HTTP reason phrase of this response, as a L{str}.z.The HTTP response L{Headers} of this response.aThe L{int} number of bytes expected to be in the body of this response or L{UNKNOWN_LENGTH} if the server did not indicate how many bytes to expect. For I{HEAD} responses, this will be 0; if the response includes a I{Content-Length} header, it will be available in C{headers}.z5The L{IClientRequest} that resulted in this response.zThe previous L{IResponse} from a redirect, or L{None} if there was no previous response. This can be used to walk the response or request history for redirections.cy)a Register an L{IProtocol} provider to receive the response body. The protocol will be connected to a transport which provides L{IPushProducer}. The protocol's C{connectionLost} method will be called with: - ResponseDone, which indicates that all bytes from the response have been successfully delivered. - PotentialDataLoss, which indicates that it cannot be determined if the entire response body has been delivered. This only occurs when making requests to HTTP servers which do not set I{Content-Length} or a I{Transfer-Encoding} in the response. - ResponseFailed, which indicates that some bytes from the response were lost. The C{reasons} attribute of the exception may provide more specific indications as to why. Nr)protocols r deliverBodyzIResponse.deliverBodyMrrcy)z Set the reference to the previous L{IResponse}. The value of the previous response can be read via L{IResponse.previousResponse}. Nr)rws rsetPreviousResponsezIResponse.setPreviousResponsecrrN)rZr[r\r]rversionrGphraseheadersrrppreviousResponserrrrrrr*sr  JG J KD N OFHIG  #FOPG  $  , rrceZdZdZdZdZy)_IRequestEncoderzy An object encoding data passed to L{IRequest.write}, for example for compression purpose. @since: 12.3 cy)z Encode the data given and return the result. @param data: The content to encode. @type data: L{str} @return: The encoded data. @rtype: L{str} Nrr9s rencodez_IRequestEncoder.encodetrrcy)z Callback called when the request is closing. @return: If necessary, the pending data accumulated from previous C{encode} calls. @rtype: L{str} Nrrrrr7z_IRequestEncoder.finishrrN)rZr[r\r]rr7rrrrrls   rrceZdZdZdZy)_IRequestEncoderFactoryzQ A factory for returing L{_IRequestEncoder} instances. @since: 12.3 cy)zn If applicable, returns a L{_IRequestEncoder} instance which will encode the request. Nrrts rencoderForRequestz)_IRequestEncoderFactory.encoderForRequestrrN)rZr[r\r]rrrrrrs   rrc@eZdZdZedZedZedZy)IClientRequestz] An object representing an HTTP request to make to an HTTP server. @since: 13.1 zcThe HTTP method for this request, as L{bytes}. For example: C{b'GET'}, C{b'HEAD'}, C{b'POST'}, etc.zmThe absolute URI of the requested resource, as L{bytes}; or L{None} if the absolute URI cannot be determined.zTHeaders to be sent to the server, as a L{twisted.web.http_headers.Headers} instance.N)rZr[r\r]rr^ absoluteURIrrrrrrs:  2F  4K  :Grrc DeZdZdZ d dededeedeedee f dZ y) IAgenta An agent makes HTTP requests. The way in which requests are issued is left up to each implementation. Some may issue them directly to the server indicated by the net location portion of the request URL. Others may use a proxy specified by system configuration. Processing of responses is also left very widely specified. An implementation may perform no special handling of responses, or it may implement redirect following or content negotiation, it may implement a cookie store or automatically respond to authentication challenges. It may implement many other unforeseen behaviors as well. It is also intended that L{IAgent} implementations be composable. An implementation which provides cookie handling features should re-use an implementation that provides connection pooling and this combination could be used by an implementation which adds content negotiation functionality. Some implementations will be completely self-contained, such as those which actually perform the network operations to send and receive requests, but most or all other implementations should implement a small number of new features (perhaps one new feature) and delegate the rest of the request/response machinery to another implementation. This allows for great flexibility in the behavior an L{IAgent} will provide. For example, an L{IAgent} with web browser-like behavior could be obtained by combining a number of (hypothetical) implementations:: baseAgent = Agent(reactor) decode = ContentDecoderAgent(baseAgent, [(b"gzip", GzipDecoder())]) cookie = CookieAgent(decode, diskStore.cookie) authenticate = AuthenticateAgent( cookie, [diskStore.credentials, GtkAuthInterface()]) cache = CacheAgent(authenticate, diskStore.cache) redirect = BrowserLikeRedirectAgent(cache, limit=10) doSomeRequests(cache) Nr^r_r bodyProducerrcy)a\ Request the resource at the given location. @param method: The request method to use, such as C{b"GET"}, C{b"HEAD"}, C{b"PUT"}, C{b"POST"}, etc. @param uri: The location of the resource to request. This should be an absolute URI but some implementations may support relative URIs (with absolute or relative paths). I{HTTP} and I{HTTPS} are the schemes most likely to be supported but others may be as well. @param headers: The headers to send with the request (or L{None} to send no extra headers). An implementation may add its own headers to this (for example for client identification or content negotiation). @param bodyProducer: An object which can generate bytes to make up the body of this request (for example, the properly encoded contents of a file for a file upload). Or, L{None} if the request is to have no body. @return: A L{Deferred} that fires with an L{IResponse} provider when the header of the response has been received (regardless of the response status code) or with a L{Failure} if there is any problem which prevents that response from being received (including problems that prevent the request from being sent). Nr)r^r_rrs rrpzIAgent.requestrr)NN) rZr[r\r]bytesrr r{r rrprrrrrsR%T&*04      '"  }-  )   rrceZdZdZdZy)IPolicyForHTTPSa An L{IPolicyForHTTPS} provides a policy for verifying the certificates of HTTPS connections, in the form of a L{client connection creator } per network location. @since: 14.0 cy)a Create a L{client connection creator } appropriate for the given URL "netloc"; i.e. hostname and port number pair. @param hostname: The name of the requested remote host. @type hostname: L{bytes} @param port: The number of the requested remote port. @type port: L{int} @return: A client connection creator expressing the security requirements for the given remote host. @rtype: L{client connection creator } Nr)hostnamerWs rcreatorForNetlocz IPolicyForHTTPS.creatorForNetlocrrN)rZr[r\r]rrrrrrs  rrceZdZdZdZy)IAgentEndpointFactoryz An L{IAgentEndpointFactory} provides a way of constructing an endpoint used for outgoing Agent requests. This is useful in the case of needing to proxy outgoing connections, or to otherwise vary the transport used. @since: 15.0 cy)a Construct and return an L{IStreamClientEndpoint} for the outgoing request's connection. @param uri: The URI of the request. @type uri: L{twisted.web.client.URI} @return: An endpoint which will have its C{connect} method called to issue the request. @rtype: an L{IStreamClientEndpoint} provider @raises twisted.internet.error.SchemeNotSupported: If the given URI's scheme cannot be handled by this factory. Nr)r_s rendpointForURIz$IAgentEndpointFactory.endpointForURI rrN)rZr[r\r]rrrrrrs  rrztwisted.web.iweb.UNKNOWN_LENGTH) r rrrr{rrrrrUNKNOWN_LENGTHN)$r]typingrrrrzope.interfacerrtwisted.cred.credentialsr twisted.internet.deferr twisted.internet.interfacesr twisted.web.http_headersr twisted.web.templater rrrgrmrrr{rrrrrrrrrr__all__rrrrs ;:/8+5,5N yN b  y & ) ,+ + \8 M8 v ) >  i  ? ? D y :  i  Y.H YH V i < I 43 r