atbasu / document-content-extractor Goto Github PK

There was an error in processing this file:
Unexpected Exception: Traceback (most recent call last):
  File "/Users/atbasu/Documents/document-content-extractor/content_extractor.py", line 463, in extract_content_async
    prompts, results = loop.run_until_complete(
                       ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/asyncio/base_events.py", line 653, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/content_extractor.py", line 406, in process_prompts
    responses = await asyncio.gather(*tasks)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/content_extractor.py", line 312, in process_chunk
    response = await session.post(
               ^^^^^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/venv/lib/python3.11/site-packages/aiohttp/client.py", line 560, in _request
    await resp.start(conn)
  File "/Users/atbasu/Documents/document-content-extractor/venv/lib/python3.11/site-packages/aiohttp/client_reqrep.py", line 899, in start
    message, payload = await protocol.read()  # type: ignore[union-attr]
                       ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/venv/lib/python3.11/site-packages/aiohttp/streams.py", line 616, in read
    await self._waiter
aiohttp.client_exceptions.ServerDisconnectedError: Server disconnected

((venv) (base) atbasu@x86_64-apple-darwin13 document-content-extractor % python3.11 document_content_extractor.py
Enter name of file : 1.pdf
Enter Open AI api key: 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
Processing sample forms/1.pdf provided using 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 and parser configuration from closewise_parser_configurator.json
Field Name                   | Field Value
+----------------------------|--------------------------------------------------+
SignerName                   | Vincent Torres
Email                        | [email protected]
PhoneNumber                  | (803) 203-2710
IsTheSignerAForeignNational? | No
Language                     | N/A
Timezone                     | Eastern Daylight Time (EDT)
PropertyAddress              | 1357 Shimmer Light Circle
AppointmentAddress           | 1357 Shimmer Light Circle
AppointmentDateAndTime       | 05/13/22 at 8:00 am (EDT)
FileNumber                   | SC22117033
OrderOnBehalfOf              | BNT
SigningType                  | Notary confirmation
ProductType                  | Refi (E DOCS)
CompanyFee                   | $200
Client                       | Vincent Torres and Dianna Sager
AgentName                    | Carolina Attorney Networ
AgentFee                     | $200
WitnessNumber                | 2
UploadFiles                  | No
InternalNotes                | Please call the signer
ExternalNotes                | Call the borrower or buyers ASAP and confirm the following information: TIME
InstructionType              | Special Instructions
ScanBacksNeeded              | Yes
PersonOfContactEmail         | [email protected]
+----------------------------|--------------------------------------------------+
Are any of the values incorrect? (y/n): n
Traceback (most recent call last):
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 235, in <module>
    main()
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 207, in main
    f"{file_path.split('/')[-1]}_corrections_{run_id}.json",
       ^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'split'
(venv) (base) atbasu@x86_64-apple-darwin13 document-content-extractor % 

Enter name of file : 1.pfg
Enter Open AI api key: sdfs
Processing sample forms/1.pfg provided using sdfs and parser configuration from closewise_parser_configurator.json
Traceback (most recent call last):
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 235, in <module>
    main()
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 182, in main
    result = upload_and_process_document(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 28, in upload_and_process_document
    text = read_document(file_path)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/utils.py", line 9, in read_document
    with open(file_path, 'rb') as file:
         ^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'sample forms/1.pfg'

Traceback (most recent call last):
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 261, in <module>
    main()
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 237, in main
    metrics_file = write_metrics(
                   ^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 66, in write_metrics
    logger.info("Writing metrics to CSV")
    ^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'info'

Invalid input. Please enter either y, n.
Invalid input. Please en^C
Traceback (most recent call last):
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 260, in <module>
    main()
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 227, in main
    corrections = check_for_errors(json_result, dce_logger)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 118, in check_for_errors
    print('Invalid input. Please enter either y, n.')
KeyboardInterrupt

Are any of the values incorrect? (y/n): y
Enter a coma separated list of fields that need to be corrected? POCPhone
What should the correct value be for POCPhone?N/A
Why is this the correct value POCPhone?no phone number for the POC is listed, (929) 270-5392 is the number of the borrower.
Are there any other fields that need to be corrected? (y/n): n
CRITICAL:utils:An error occurred while checking for any incorrect extractions: 'POCPhone'

Traceback (most recent call last):
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 302, in main
    corrections, correction_prompt = check_for_errors(
                                     ^^^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 187, in check_for_errors
    correction_prompt = generate_correction_prompt(corrections, result)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/atbasu/Documents/document-content-extractor/document_content_extractor.py", line 127, in generate_correction_prompt
    returned_values += f"{key} : {result[key]}\n"
                                  ~~~~~~^^^^^
KeyError: 'POCPhone'

Processing sample forms/01-01711646.pdf provided using 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 and parser configuration from closewise_parser_configurator.json
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/aiohttp/connector.py", line 980, in _wrap_create_connection
    return await self._loop.create_connection(*args, **kwargs)  # type: ignore[return-value]  # noqa
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/asyncio/base_events.py", line 1112, in create_connection
    transport, protocol = await self._create_connection_transport(
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/asyncio/base_events.py", line 1145, in _create_connection_transport
    await waiter
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/asyncio/sslproto.py", line 574, in _on_handshake_complete
    raise handshake_exc
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/asyncio/sslproto.py", line 556, in _do_handshake
    self._sslobj.do_handshake()
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/ssl.py", line 979, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/akhileshthapliyal/document-content-extractor/document-content-extractor.py", line 244, in <module>
    main()
  File "/Users/akhileshthapliyal/document-content-extractor/document-content-extractor.py", line 207, in main
    file_path, api_key, json_result, config, usage, result_file = upload_and_process_document(
                                                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/akhileshthapliyal/document-content-extractor/document-content-extractor.py", line 60, in upload_and_process_document
    result = extract_content_async(
             ^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/akhileshthapliyal/document-content-extractor/content_extractor.py", line 294, in extract_content_async
    prompts, results = loop.run_until_complete(
                       ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/asyncio/base_events.py", line 653, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/Users/akhileshthapliyal/document-content-extractor/content_extractor.py", line 211, in process_prompts
    responses = await asyncio.gather(*tasks)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/akhileshthapliyal/document-content-extractor/content_extractor.py", line 74, in process_chunk
    response = await session.post(
               ^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/aiohttp/client.py", line 536, in _request
    conn = await self._connector.connect(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/aiohttp/connector.py", line 540, in connect
    proto = await self._create_connection(req, traces, timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/aiohttp/connector.py", line 901, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/aiohttp/connector.py", line 1206, in _create_direct_connection
    raise last_exc
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/aiohttp/connector.py", line 1175, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/aiohttp/connector.py", line 982, in _wrap_create_connection
    raise ClientConnectorCertificateError(req.connection_key, exc) from exc
aiohttp.client_exceptions.ClientConnectorCertificateError: Cannot connect to host api.openai.com:443 ssl:True [SSLCertVerificationError: (1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)')]

Field Name                   | Field Value
+----------------------------|--------------------------------------------------+
borrowerName_1               | Eric Robert Matthews
borrowerEmail_1              | 
borrowerCellPhone_1          | (310) 418-3470
borrowerName_2               | 
borrowerEmail_2              | 
borrowerCellPhone_2          | 
isTheSignerAForeignNational? | No
language                     | 
timezone                     | 
propertyAddress_Line         | 915 Via Colinas
propertyAddress_City         | Westlake Village
propertyAddress_State        | CA
propertyAddress_Zip          | 92660
closingAddress_Line          | 915 VIA COLINAS
closingAddress_City          | WESTLAKE VILLAGE
closingAddress_State         | CA
closingAddress_Zip           | 91362
appointmentDateTime          | 10/12/2022 10:00 AM
fileNumber                   | OPA-4747851
orderOnBehalfOf              | DEANNA GOOD
signingType                  | DISBURSEMENT ONLY
closingType                  | Home Equity Loan
lender                       | Title365
titleCompany                 | Vendor Name
companyFee                   | $90.00
agentFee                     | N/A
witnessNumber                | N/A
uploadFiles                  | N/A
isScanBackNeeded             | N/A
pocName                      | DEANNA GOOD
pocPhone                     | (310) 418-3470
pocEmail                     | N/A
+----------------------------|--------------------------------------------------+
Are any of the values incorrect? (y/n): y
Enter a coma separated list of fields that need to be corrected? propertyAddress_Zip, titleCompany, pocPhone
propertyAddress_Zip is an invalid field_name. Please enter a valid field name.
titleCompany is an invalid field_name. Please enter a valid field name.
pocPhone is an invalid field_name. Please enter a valid field name.