As per our previous update the issue is related to the APS application as it uses URL such as '/aps/2/resources/edaa6f38-ecd9-4be5-9964-10370f2a13e4/emails' which will not list more than 1000 emails.

[2017-06-01 06:24:14] Context.INFO: updateResources: start [] []
[2017-06-01 06:24:14] Context.INFO: updateResources: Starting update process for resource ([email protected]) [] []
[2017-06-01 06:24:14] Context.WARNING: [REPORT]: SE email resource '[email protected]' not found. Use the 'Protect' action to have it created and protected. [] []
[2017-06-01 06:24:14] Context.INFO: updateResources: stop [] []
[2017-06-01 06:24:17] Context.INFO: updateResources: start [] []
[2017-06-01 06:24:17] Context.INFO: updateResources: Starting update process for resource ([email protected]) [] []
[2017-06-01 06:24:17] Context.INFO: updateResources: Protecting resource [] []
[2017-06-01 06:24:17] Context.INFO: protectResource: start [] []
[2017-06-01 06:24:17] Context.INFO: protectResource: Protection process starting [] []
[2017-06-01 06:24:17] Context.WARNING: [REPORT]: Domain not protected. (gmail.com) [] []
[2017-06-01 06:24:17] Context.WARNING: [REPORT]: Domain 'gmail.com' not protected, please make sure it is in order to add this email. ([email protected]). [] []
[2017-06-01 06:24:17] Context.INFO: protectResource: stop [] []
[2017-06-01 06:24:17] Context.INFO: updateResources: stop [] []

[root@endpoint ~]# tail -fn0 /var/www/html/spamexperts/logs/app-log-2018-07-24
...
[2018-07-24 19:33:15] Context.INFO: replaceMXRecords: Setting up record: ****. -> ****. [] []
[2018-07-24 19:33:15] Context.INFO: replaceMXRecords: Linking new record to domain records collection [] []
[2018-07-24 19:33:16] Context.WARNING: [REPORT]: Could not replace MX records for domain '*******'. [exception 'Rest\RestException' with message 'Can not create DNS Record for '__host__'. There is an existing __rr_type__ record (__host__ __data__, #__rr_id__) already.' in /usr/share/aps/php/aps/2/apsc.php:383 Stack trace: #0 /usr/share/aps/php/aps/2/apsc.php(989): APS\Proto->sendRequest('POST', 'aps/7.2/resourc...', '{\n "aps": {\n...') #1 /var/www/html/spamexperts/context.php(1106): APS\ControllerProxy->linkResource(Object(com\parallels\aps\types\pa\dns\zone\v1\v1\PAHostedDomain), 'records', Object(com\parallels\aps\types\pa\dns\record\mx\v1\v0\PADnsMXRecord)) #2 /var/www/html/spamexperts/context.php(821): context->replaceMXRecords(Object(com\parallels\aps\types\pa\dns\zone\v1\v1\PAHostedDomain)) #3 /var/www/html/spamexperts/context.php(758): context->protectResource(Object(com\parallels\aps\types\pa\dns\zone\v1\v1\PAHostedDomain)) #4 /var/www/html/spamexperts/context.php(577): context->updateResources(Array, true) #5 [internal function]: context->domainProtect('["0b4c7084-8cad...') #6 /usr/share/aps/php/aps/2/rest.php(1093): call_user_func_array(Array, Array) #7 /usr/share/aps/php/aps/2/runtime.php(402): Rest\RestService->handle() #8 /usr/share/aps/php/aps/2/runtime.php(460): APS\Loader->handleHttpRequest() #9 /usr/share/aps/php/aps/2/runtime.php(472): APS\Loader->process() #10 [internal function]: APS\Loader->__destruct() #11 {main}] [] []
...
[2018-07-24 19:33:16] Context.WARNING: [REPORT]: Failed to replace domain MX records. This is an issue with POA/APS, please contact support for further information. (****) [] []
...
[2018-07-24 19:33:16] Context.WARNING: [REPORT]: Domain MX records aren't set correctly. The 'Protect' action may fix this for you, otherwise please contact your service provider. (****) [] []
...

# curl -k -E /usr/local/pem/APS/certificates/poa.pem 'https://localhost:6308/aps/2/resources/0b4c7084-8cad-4b68-98f3-23cd11a4e289/records?and(implementing(http://parallels.com/aps/types/pa/dns/record/mx/1.0),out(exchange,(****.,****.)),sort(+priority))'
[
  {
    "aps": {
      "type": "http://parallels.com/aps/types/pa/dns/record/mx/1.0",
      "id": "b75ff167-dd8e-4612-a1ee-0d5fa9ba9965",
      "status": "aps:ready",
      "revision": 2,
      "modified": "2017-01-09T13:32:06Z"
    },
    "RRState": "active",
    "TTL": 3600,
    "exchange": "****",
    "priority": 10,
    "recordId": 50079,
    "source": "",
    "sourceFQN": "****.",
    "data": "10 ****."
  },
  {
    "aps": {
      "type": "http://parallels.com/aps/types/pa/dns/record/mx/1.0",
      "id": "4afc30a3-f4f7-463a-9f32-4b866d3ec68d",
      "status": "aps:ready",
      "revision": 3,
      "modified": "2017-01-09T13:32:56Z",
      "subscription": "ec766935-91ca-44ff-bf5e-2f805606ecaf"
    },
    "RRState": "active",
    "TTL": 3600,
    "exchange": "****",
    "source": "",
    "priority": 20,
    "recordId": 50080,
    "sourceFQN": "****.",
    "data": "20 ****."
  },
  {
    "aps": {
      "type": "http://parallels.com/aps/types/pa/dns/record/mx/1.0",
      "id": "4b8800d3-eab7-4889-a9c5-e314e67222af",
      "status": "aps:ready",
      "revision": 2,
      "modified": "2017-01-09T13:32:15Z"
    },
    "RRState": "active",
    "TTL": 3600,
    "exchange": "****",
    "priority": 20,
    "recordId": 50080,
    "source": "",
    "sourceFQN": "****.",
    "data": "20 ****."
  }
]

APP-META.xml:116: Warning aps215: Navigation element id 'suwizard.new' does not
match regular expression '^[a-zA-Z_\-][a-zA-Z_0-9\-]*$'.
APP-META.xml:120: Warning aps215: Navigation element id 'suwizard.overview' does
 not match regular expression '^[a-zA-Z_\-][a-zA-Z_0-9\-]*$'.
APP-META.xml:123: Warning aps215: Navigation element id 'suservice.view' does no
t match regular expression '^[a-zA-Z_\-][a-zA-Z_0-9\-]*$'.

archiving_space - will count archiving disk space in mb
archiving_quota_soft - here you can set the soft quota in mb
archiving_quota_hard - here you can set the hard  quota in mb
archiving_accounts - will count archiving accounts

/api/domain/getstorage/domain/<string>/
/api/domain/setsoftquota/domain/<string>/quota/<int or string>/
/api/domain/sethardquota/domain/<string>/quota/<int or string>/

2018-04-13 05:44:40] Email.INFO: unprovision: Removing SE email user resource [] []
[2018-04-13 05:44:40] API_Client.DEBUG: removeEmailUser: Email user removal request [] []
[2018-04-13 05:44:41] API_Client.DEBUG: >>>>>>>> GET /api/emailusers/remove/username/[email protected] HTTP/1.1 Host: my.nospamcloud.com User-Agent: ProSpamFilter/2.0-17 Authorization: Basic dHQteXNhdG8wMV8xMDM4Mzg5OmY4MmUwM2FjZjhjZDkxMGFhYWJhODk4MDI0MGJjNTVj <<<<<<<< HTTP/1.1 200 OK Server: nginx Content-Type: text/html; charset=UTF-8 Transfer-Encoding: chunked Connection: keep-alive Vary: Accept-Encoding Expires: Thu, 19 Nov 1981 08:52:00 GMT Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0, no-cache Pragma: no-cache Set-Cookie: SESESSID=muoln649086rmuch07cj6c84r1; expires=Fri, 13-Apr-2018 06:44:40 GMT; Max-Age=3600; path=/; HttpOnly, returnToDomain=; expires=Thursday, 12-Apr-2018 14:44:40 JST Date: Fri, 13 Apr 2018 05:44:41 GMT SUCCESS: Delivery Email Scout Reports where removed for this user SUCCESS: Submission Email Scout Reports where removed for this user SUCCESS: Successfully deleted -------- {"request":"[object] (Guzzle\Http\Message\Request: {})","response":"[object] (Guzzle\Http\Message\Response: {})","handle":"[object] (Guzzle\Http\Curl\CurlHandle: {})"} []
[2018-04-13 05:44:41] API_Client.DEBUG: removeEmailUser: Result: true Response: 'SUCCESS: Delivery Email Scout Reports where removed for this user SUCCESS: Submission Email Scout Reports where removed for this user SUCCESS: Successfully deleted ' [] []
[2018-04-13 05:44:41] Email.INFO: unprovision: stop [] []
[2018-04-13 05:44:41] Context.INFO: unprotectResources: stop [] []

The last error - "Service Creation Failed: Operation Automation service was not created. Task "Provisioning "context" for APS application SpamExperts" (id = 15945252) is failed with error: "APS Application Error:
500 Internal Server Error
[Exception] Provisioning: resource 674d05e8-28c7-4c8f-925d-8e14196c7450 of type 'context' (http://aps.spamexperts.com/app/context/2.0) for APS application 'SpamExperts-2.0-15': Internal Server Error: ERROR: Couldn't create a SpamExperts account for the new subscription. More details can be found in the logs (if advanced logging has been enabled)..
Body: {
"code": 500,
"error": "Exception",
"message": "Internal Server Error: ERROR: Couldn't create a SpamExperts account for the new subscription. More details can be found in the logs (if advanced logging has been enabled).",
"http_request": "POST /spamexperts/context to 'provisioning02.example.com'"
}
". Service Creation Failed: Operation Automation service was not created. Task "Provisioning "context" for APS application SpamExperts" (id = 15945252) is failed with error: "APS Application Error:
500 Internal Server Error
[Exception] Provisioning: resource 674d05e8-28c7-4c8f-925d-8e14196c7450 of type 'context' (http://aps.spamexperts.com/app/context/2.0) for APS application 'SpamExperts-2.0-15': Internal Server Error: ERROR: Couldn't create a SpamExperts account for the new subscription. More details can be found in the logs (if advanced logging has been enabled)..

Body: {
"code": 500,
"error": "Exception",
"message": "Internal Server Error: ERROR: Couldn't create a SpamExperts account for the new subscription. More details can be found in the logs (if advanced logging has been enabled).",
"http
```_request": "POST /spamexperts/context to 'provisioning02.example.com'"
}
".".
Please check the "Provisioning item" (details) and the last items of the "Service Status History" (details) of the associated subscriptions for more details. As soon as you fix the problem, resubmit this order for provisioning.
Additional information about this error in Odin Knowledge Base - Click here to find a solution

Errorlog :

provisioning02.example.com:/var/www/html/spamexperts # less logs/app-log-2017-02-02
[2017-02-02 11:35:24] Service.INFO: provision: start [] []
[2017-02-02 11:35:24] Service.INFO: provision: stop [] []
[2017-02-02 14:32:35] Context.INFO: provision: start [] []
[2017-02-02 14:32:35] Context.INFO: provision: Provisioning context [] []
[2017-02-02 14:32:36] Context.INFO: provision: Creating new SE account [] []
[2017-02-02 14:32:36] Context.INFO: createReseller: start [] []
[2017-02-02 14:32:36] Context.INFO: createReseller: Creating SE account [] []
[2017-02-02 14:32:37] Context.INFO: createReseller: stop [] []
[2017-02-02 14:32:37] Context.ERROR: provision: Couldn't create SE account! [] []
logs/app-log-2017-02-02 (END)

Logs:

provisioning02.example.com:/var/www/html/spamexperts/logs # less app-log-2017-02-03
[2017-02-03 07:50:55] Context.INFO: provision: start [] []
[2017-02-03 07:50:55] Context.INFO: provision: Provisioning context [] []
[2017-02-03 07:50:56] Context.INFO: provision: Creating new SE account [] []
[2017-02-03 07:50:56] Context.INFO: createReseller: start [] []
[2017-02-03 07:50:56] Context.INFO: createReseller: Creating SE account [] []
[2017-02-03 07:50:56] API_Client.DEBUG: addReseller: Add reseller request [] []
[2017-02-03 07:50:57] API_Client.DEBUG: >>>>>>>> GET /api/reseller/add/username/simplyit36_1009580/password/  /email/[email protected]/domainslimit/0/api_usage/1 HTTP/1.1 Host: login.example.com User-Agent: ProSpamFilter/2.0-15 Authorization: Basic <<<<<<<< HTTP/1.1 200 OK Server: nginx/1.10.2 Content-Type: text/html; charset=UTF-8 Transfer-Encoding: chunked Connection: keep-alive Vary: Accept-Encoding Expires: Thu, 19 Nov 1981 08:52:00 GMT Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0, no-cache Pragma: no-cache Set-Cookie: SESESSID=xxxxxxl16; expires=Fri, 03-Feb-2017 08:50:56 GMT; Max-Age=3600; path=/; HttpOnly, returnToDomain=; expires=Thursday, 02-Feb-2017 08:50:56 CET Date: Fri, 03 Feb 2017 07:50:57 GMT ERROR: The domains limit value cannot be 0. ERROR: User ID is invalid -------- {"request":"[object] (Guzzle\\Http\\Message\\Request: {})","response":"[object] (Guzzle\\Http\\Message\\Response: {})","handle":"[object] (Guzzle\\Http\\Curl\\CurlHandle: {})"} []
[2017-02-03 07:50:57] API_Client.DEBUG: addReseller: Result: false Response: 'ERROR: The domains limit value cannot be 0. ERROR: User ID is invalid ' [] []
[2017-02-03 07:50:57] Context.INFO: createReseller: stop [] []
[2017-02-03 07:50:57] Context.ERROR: provision: Couldn't create SE account! [] [] 


ID #321118

1. Whenever one try to access the panel in APS, this screen is built by APS itself which for your information retrieve all details needed for the screen via RQL to OA APS resources.

2. As for the reported SpamExpert APS, it uses below RQL to retrieve the domain listing which then displayed in the screen (this can be seen clearly in the Firebug plugin in Firefox):

----------------------------------------------------------------------------------------------------

https://***/aps/2/resources/f4aa9eaf-7106-4f68-8ae1-***/domains?limit(0,10)

----------------------------------------------------------------------------------------------------

3. As you can see above, the ID 'f4aa9eaf-7106-4f68-8ae1-***' actually refers to the account 1006*** and thus, '/domains' actually refers to all domains under this account.

4. Due to no filtration design within SpamExpert APS itself, this RQL then retrieve those domains as it is and this can be seen processed within /var/log/pa/core.log

5. You may also verify this by running curl command below which you will see that it retrieves all of the domains under this account rather than domains within subscription:

-----------------------------------------------------------------------------------------------------------------------------------------------------------

curl -k -E /usr/local/pem/APS/certificates/poa.pem -X GET "https://127.0.0.1:6308/aps/2/resources/f4aa9eaf-7106-4f68-8ae1-***/domains?limit(0,10)"

-----------------------------------------------------------------------------------------------------------------------------------------------------------

[root@ ~]# curl -kE /usr/local/pem/APS/certificates/poa.pem "https://127.0.0.1:6310/aps/2/resources/***" -X GET
{
       "aps":
       {
               "type": "http://parallels.com/aps/types/pa/dns/record/mx/1.0",
               "id": "***",
               "status": "aps:ready",
               "revision": 8,
               "modified": "2018-12-18T15:25:53Z",
               "subscription": "***",
               "schema": "/aps/2/types/57",
               "package":
               {
                       "id": "***",
                       "href": "***"
               }
       },
       "RRState": "active",
       "TTL": 3600,
       "source": "",
       "exchange": "mx1.spamexpertsfilter.me",
       "priority": 10,
       "recordId": 138907,
       "data": "10 mx1.spamexpertsfilter.me.",
       "sourceFQN": "example.com.",
       "zone":
       {
               "aps":
               {
                       "link": "strong",
                       "href": "/aps/2/resources/***",
                       "id": "***",
                       "subscription": "***"
               }
       },
       "replacedBy":
       {
               "aps":
               {
                       "link": "collection",
                       "href": "/aps/2/resources/***/replacedBy"
               }
       },
       "replaces":
       {
               "aps":
               {
                       "link": "collection",
                       "href": "/aps/2/resources/***/replaces"
               }
       }
}

TypeError: k is not a function
    at c (VM1369 aps.js:111)
    at l.then.b.then (VM1369 aps.js:114)
    at VM3501 suwizard.overview.html:23
    at sa (VM1369 aps.js:19)
    at VM1369 aps.js:19
    at ta (VM1369 aps.js:19)
    at qa (VM1369 aps.js:19)
    at e (VM1369 aps.js:20)
    at VM1369 aps.js:804
    at Object.F [as init] (VM1375 i18next.js:10) "TypeError: k is not a function
    at c (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:111:423)
    at l.then.b.then (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:114:232)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/packages/35b6a53c-3844-4f21-8556-cecb7a3807d8/ui/suwizard.overview.html:23:53
    at sa (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:3)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:240
    at ta (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:125)
    at qa (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:180)
    at e (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:20:15)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:804:209
    at Object.F [as init] (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/3rd-party/i18next/i18next.js:10:203)
    ----------------------------------------
    rejected at a (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:112:313)
    at c (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:112:65)
    at l.then.b.then (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:114:232)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/packages/35b6a53c-3844-4f21-8556-cecb7a3807d8/ui/suwizard.overview.html:23:53
    at sa (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:3)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:240
    at ta (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:125)
    at qa (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:180)
    at e (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:20:15)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:804:209
    ----------------------------------------
Error
    at l.then.b.then (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:114:177)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/packages/35b6a53c-3844-4f21-8556-cecb7a3807d8/ui/suwizard.overview.html:23:53
    at sa (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:3)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:240
    at ta (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:125)
    at qa (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:19:180)
    at e (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:20:15)
    at http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:804:209
    at Object.F [as init] (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/3rd-party/i18next/i18next.js:10:203)
    at p (http://osa60.lestifeev.apsdemo.org:8080/aps/2/ui/runtime/client/aps/aps.js:804:119)"
f @ VM1369 aps.js:118
(anonymous) @ VM1369 aps.js:118
filter @ VM1369 aps.js:49
c @ VM1369 aps.js:118

The issue of why other service users from other customers are displayed on Hosting CP (Provider CP) for Spamexperts are due to the design of the APS applications, which do not implement proper filtering.
Since the APS is packaged by Spamexperts, please contact Spamexperts team with the description of this problem

APS Application Error:
500 Internal Server Error
[Exception] Provisioning: resource c4f6e654-1467-***** of type 'context' (http://aps.spamexperts.com/app/context/2.0) for APS application 'SpamExperts-2.0-15': Internal Server Error: Only variables should be passed by reference at /var/www/html/spamexperts/context.php:258.

Body: {
"code": 500,
"error": "Exception",
"message": "Internal Server Error: Only variables should be passed by reference at /var/www/html/spamexperts/context.php:258",
"http_request": "POST /spamexperts/context to '*******'"
}

Task ID
13893964
Task name
Upgrading resources of application 'SpamExperts'
Task description
Upgrading resources of application SpamExperts 2.0-10 to version 2.0-15
Belongs to groups
2699:154194302
Parent task ID
13893963
Queue status
Failed
Start not earlier than
Jan-25-2017 20:03
Method name
taskUpgradeApp2x on SCREF:SaaSManagerTasks:0
Last execution output
Internal error: APSC: Upgrade to ver. 2.0-15 : resource 399ad95e-0941-4e38-9d38-9bd9e02beea7 of type 'service' (http://aps.spamexperts.com/app/service/1.3) for APS application 'SpamExperts-2.0-15' : The operation with name 'onContextAvailable' is not found..

Internal error: APSC: Upgrade to ver. 2.0-15 : resource 399ad95e-0941-4e38-9d38-9bd9e02beea7 of type 'service' (http://aps.spamexperts.com/app/service/1.3) for APS application 'SpamExperts-2.0-15' : Internal Server Error: Unknown method "onContextAvailabeSubscribe"..

[root@oa73a ~]# tail -fn0 /var/log/pa/pui/pui.log  | grep Ambiguity
23:53:24.794 [default task-225] WARN  c.o.a.service.navigation.StaticModel - Ambiguity in finding a parent for 'view-plugin@http://www.odin.com/oa/billing/paymentmanagement#paymentMethodSelector'. Trying to assign 'plugin-placeholder@http://www.parallels.com/ccp-billing-financial-documents#payment-method-selector' but 'plugin-placeholder@http://www.parallels.com/ccp-billing-financial-documents#payment-method-selector' is already assigned! Behavior now depends on order of elements and packages!