PayPal IPN random fails
- micheleq
- OFFLINE
-
Elite Member
- Posts: 191
- Thanks: 22
- Karma: 5
6 months 2 weeks ago - 6 months 2 weeks ago #335456
by micheleq
Both sites have close to identical setups.
There's one main plan (now that you have implemented the payment options, thank you) and several "sub" plans.
Here's an example of a &cbpgacctno=1 that passed OK
And here's an example of a &cbpgacctno=2 that failed with error 500.
This is why I can't make heads or tails of it. Some go and others don't. So only for some, the error is stopping the whole process early on. I agree that there's some serious concern.
One possibility is that the error is happening when it's first trying to write to the database, failing and returning error 500. Remember that when I tried to enter the failing urls I always had the error "1062 Duplicate entry '12' for key 'jos_cbsubs_notifications.PRIMARY'" This is a wild guess, but it's all I can think of.
On a side note:
Here are the latest fails:
Thank you for your help on this.
Tomás
Replied by micheleq on topic PayPal IPN random fails
It's happening on both sitesCBSubs not logging anything is concerning. That usually means CBSubs wasn't loaded yet since our logging hooks directly into PHP error handler. It's likely there's something else on the site possibly causing your issue. You mentioned both sites. Is this happening on both sites or only 1 of them?
I have 6 PayPal gateways, that's what I was referring to with the different gateway owners and secondary gateways.There's also a potential concern in your access log. Notice the one that succeeded has &cbpgacctno=2 and the one that failed has &cbpgacctno=1. cbpgacctno is the gateway id. So the one that succeeded has a gateway id of 2 and the one that failed has a gateway id of 1. Please check your payment gateways within CBSubs > Gateways and review your settings for the gateway with an id of 1. Seams like you have 2 PayPal gateways?
Both sites have close to identical setups.
There's one main plan (now that you have implemented the payment options, thank you) and several "sub" plans.
- Users have to register and get access to the site via the main plan, which has 2 gateways: my PayPal and my Stripe. Both have Owner=0
- Once they are members, users can take classes from a handful of teachers on the site.
- These teachers have their own PayPal gateway (Owner 1 through 5) which are linked to their individual PayPal accounts and I don't see or control.
- Right now I have only 3 active teachers and all 3 are having issues, including me with Owner=0.
Here's an example of a &cbpgacctno=1 that passed OK
mysite2.com:443 173.0.81.65 - - [07/Oct/2023:06:47:57 +0200] "POST /index.php?option=com_comprofiler&view=pluginclass&plugin=cbpaidsubscriptions&cbpgacctno=1&cbpbasket=9856&do=gw&result=notify&cbpid=cbp652xxxxxxxxxxxxxxx1419&format=raw HTTP/1.1" 200 5008 "-" "PayPal IPN ( https://www.paypal.com/ipn )"
mysite2.com:443 173.0.81.140 - - [07/Oct/2023:06:47:59 +0200] "POST /index.php?option=com_comprofiler&view=pluginclass&plugin=cbpaidsubscriptions&cbpgacctno=1&cbpbasket=9856&do=gw&result=notify&cbpid=cbp652xxxxxxxxxxxxxxx1419&format=raw HTTP/1.1" 200 5008 "-" "PayPal IPN ( https://www.paypal.com/ipn )"And here's an example of a &cbpgacctno=2 that failed with error 500.
mysite2.com:443 173.0.81.140 - - [07/Oct/2023:08:50:18 +0200] "POST /index.php?option=com_comprofiler&view=pluginclass&plugin=cbpaidsubscriptions&cbpgacctno=2&cbpbasket=9852&do=gw&result=notify&cbpid=cbp651xxxxxxxxxxxxxxx080&format=raw HTTP/1.1" 500 25096 "-" "PayPal IPN ( https://www.paypal.com/ipn )"This is why I can't make heads or tails of it. Some go and others don't. So only for some, the error is stopping the whole process early on. I agree that there's some serious concern.
One possibility is that the error is happening when it's first trying to write to the database, failing and returning error 500. Remember that when I tried to enter the failing urls I always had the error "1062 Duplicate entry '12' for key 'jos_cbsubs_notifications.PRIMARY'" This is a wild guess, but it's all I can think of.
On a side note:
Warning: Spoiler!
I had an issue with Kunena when upgrading to J4: I implemented the "invites" CB plugin and set the site where the only signups are through invitations. Signups had been closed for a couple of years. When testing the implementation, the registrations would always fail. CB is connected to Kunena and I have a "status text" which is linked to Kunena. On upgrading to J4, Kunena requires an uninstall and re-install. The process was failing when accessing the Kunena table and the "status_text" didn't have a default value set in the table structure. I fixed that and all was fine. The other separate issue I encountered was with the 'websiteurl' linked record where in CB the table record was set to 'TEXT' while the matching Kunena record was set to 'VARCHAR(50)' There was one user with a longer URL that prevented their profile to save. I changed the Kunena table to 'TEXT' and solved it. Neither had been an issue before the J4 upgrade.
Here are the latest fails:
mysite2.com:443 173.0.81.140 - - [19/Oct/2023:00:24:03 +0200] "POST /index.php?option=com_comprofiler&view=pluginclass&plugin=cbpaidsubscriptions&cbpgacctno=1&cbpbasket=4271&do=gw&result=notify&cbpid=cbp605xxxxxxxxxxxxxxx2504&format=raw HTTP/1.1" 500 24755 "-" "PayPal IPN ( https://www.paypal.com/ipn )"
mysite2.com:443 173.0.81.65 - - [19/Oct/2023:00:53:34 +0200] "POST /index.php?option=com_comprofiler&view=pluginclass&plugin=cbpaidsubscriptions&cbpgacctno=4&cbppdtback=2f6fxxxxxxxxxxxxxxxd24bab1&cbpbasket=528&do=gw&result=notify&cbpid=cbp5c6xxxxxxxxxxxxxxx1293&format=raw HTTP/1.1" 500 24829 "-" "PayPal IPN ( https://www.paypal.com/ipn )"
mysite2.com:443 173.0.81.140 - - [19/Oct/2023:00:57:42 +0200] "POST /index.php?option=com_comprofiler&view=pluginclass&plugin=cbpaidsubscriptions&cbpgacctno=4&cbpbasket=1232&do=gw&result=notify&cbpid=cbp5dd2xxxxxxxxxxxxxxx090&format=raw HTTP/1.1" 500 24738 "-" "PayPal IPN ( https://www.paypal.com/ipn )"Thank you for your help on this.
Tomás
Last edit: 6 months 2 weeks ago by micheleq.
Please Log in to join the conversation.
krileon
Team Member- OFFLINE
- Posts: 68555
- Thanks: 9095
- Karma: 1434
6 months 2 weeks ago #335461
by krileon
Kyle (Krileon)
Community Builder Team Member
Before posting on forums: Read FAQ thoroughly + Read our Documentation + Search the forums
CB links: Documentation - Localization - CB Quickstart - CB Paid Subscriptions - Add-Ons - Forge
--
If you are a Professional, Developer, or CB Paid Subscriptions subscriber and have a support issue please always post in your respective support forums for best results!
--
If I've missed your support post with a delay of 3 days or greater and are a Professional, Developer, or CBSubs subscriber please send me a private message with your thread and will reply when possible!
--
Please note I am available Monday - Friday from 8:00 AM CST to 4:00 PM CST. I am away on weekends (Saturday and Sunday) and if I've missed your post on or before a weekend after business hours please wait for the next following business day (Monday) and will get to your issue as soon as possible, thank you.
--
My role here is to provide guidance and assistance. I cannot provide custom code for each custom requirement. Please do not inquire me about custom development.
Replied by krileon on topic PayPal IPN random fails
You may also want to consider getting rid of the multiple PayPal setups. I recommend using Stripe and handling payouts through Stripe. Effectively you would pay them instead of trying to link multiple PayPal accounts to a single system. You could of course do the same with PayPal as well, but Stripe lets you automate this using Connect. PayPal might have an automated way as well, but I've no idea what it is.
You can try purging notifications by emptying the _cbsubs_notifications table and see if that stops that from happening. If you need those notifications just make a copy of the table before doing this (e.g. _cbsubs_notifications_backup). It's possible something broke the auto incrementing of the table.One possibility is that the error is happening when it's first trying to write to the database, failing and returning error 500. Remember that when I tried to enter the failing urls I always had the error "1062 Duplicate entry '12' for key 'jos_cbsubs_notifications.PRIMARY'" This is a wild guess, but it's all I can think of.
Kyle (Krileon)
Community Builder Team Member
Before posting on forums: Read FAQ thoroughly + Read our Documentation + Search the forums
CB links: Documentation - Localization - CB Quickstart - CB Paid Subscriptions - Add-Ons - Forge
--
If you are a Professional, Developer, or CB Paid Subscriptions subscriber and have a support issue please always post in your respective support forums for best results!
--
If I've missed your support post with a delay of 3 days or greater and are a Professional, Developer, or CBSubs subscriber please send me a private message with your thread and will reply when possible!
--
Please note I am available Monday - Friday from 8:00 AM CST to 4:00 PM CST. I am away on weekends (Saturday and Sunday) and if I've missed your post on or before a weekend after business hours please wait for the next following business day (Monday) and will get to your issue as soon as possible, thank you.
--
My role here is to provide guidance and assistance. I cannot provide custom code for each custom requirement. Please do not inquire me about custom development.
Please Log in to join the conversation.
- micheleq
- OFFLINE
-
Elite Member
- Posts: 191
- Thanks: 22
- Karma: 5
6 months 1 week ago #335481
by micheleq
I could dump the table, but I'm not sure that would help. I have noticed that while the table #_cbsubs_payments_baskets is skipping some numbers in the auto increment ID, however #_cbsubs_notifications is not.
I've also noticed in looking at the tables that there seems to be a mixture of collations some are utf8mb3_general_ci while others are uft8mb4_unicode_ci
Could this be interfering in writing to the tables? CBSubs tables seem to be all utf8mb3_general_ci while comprofiler tables are a mix.
I've noticed that the notifications having issues are from Germany, France and Brazil. I don't see any failures from the US or UK.
If the collations should be updated to utf8mb4, what would be the best way to do that?
Thank you,
Tomás
PS I've attached phpMyAdmin screenshots
Replied by micheleq on topic PayPal IPN random fails
That would be a very difficult task. There's hundreds of recurring subscriptions that would have to be cancelled and moved to Stripe.You may also want to consider getting rid of the multiple PayPal setups. I recommend using Stripe and handling payouts through Stripe. Effectively you would pay them instead of trying to link multiple PayPal accounts to a single system. You could of course do the same with PayPal as well, but Stripe lets you automate this using Connect. PayPal might have an automated way as well, but I've no idea what it is.
I could dump the table, but I'm not sure that would help. I have noticed that while the table #_cbsubs_payments_baskets is skipping some numbers in the auto increment ID, however #_cbsubs_notifications is not.
I've also noticed in looking at the tables that there seems to be a mixture of collations some are utf8mb3_general_ci while others are uft8mb4_unicode_ci
Could this be interfering in writing to the tables? CBSubs tables seem to be all utf8mb3_general_ci while comprofiler tables are a mix.
I've noticed that the notifications having issues are from Germany, France and Brazil. I don't see any failures from the US or UK.
If the collations should be updated to utf8mb4, what would be the best way to do that?
Thank you,
Tomás
PS I've attached phpMyAdmin screenshots
Please Log in to join the conversation.
- krileon
- Team Member
- OFFLINE
- Posts: 68555
- Thanks: 9095
- Karma: 1434
6 months 1 week ago #335482
by krileon
Kyle (Krileon)
Community Builder Team Member
Before posting on forums: Read FAQ thoroughly + Read our Documentation + Search the forums
CB links: Documentation - Localization - CB Quickstart - CB Paid Subscriptions - Add-Ons - Forge
--
If you are a Professional, Developer, or CB Paid Subscriptions subscriber and have a support issue please always post in your respective support forums for best results!
--
If I've missed your support post with a delay of 3 days or greater and are a Professional, Developer, or CBSubs subscriber please send me a private message with your thread and will reply when possible!
--
Please note I am available Monday - Friday from 8:00 AM CST to 4:00 PM CST. I am away on weekends (Saturday and Sunday) and if I've missed your post on or before a weekend after business hours please wait for the next following business day (Monday) and will get to your issue as soon as possible, thank you.
--
My role here is to provide guidance and assistance. I cannot provide custom code for each custom requirement. Please do not inquire me about custom development.
Replied by krileon on topic PayPal IPN random fails
Suggest emptying the _cbsubs_notifications table and correcting all collations to uft8mb4_unicode_ci. See if that helps your issue. As for updating the collations you should be able to use phpmyadmin to do that as there's a feature under the Operations table to change collation for entire tables including their columns.
Kyle (Krileon)
Community Builder Team Member
Before posting on forums: Read FAQ thoroughly + Read our Documentation + Search the forums
CB links: Documentation - Localization - CB Quickstart - CB Paid Subscriptions - Add-Ons - Forge
--
If you are a Professional, Developer, or CB Paid Subscriptions subscriber and have a support issue please always post in your respective support forums for best results!
--
If I've missed your support post with a delay of 3 days or greater and are a Professional, Developer, or CBSubs subscriber please send me a private message with your thread and will reply when possible!
--
Please note I am available Monday - Friday from 8:00 AM CST to 4:00 PM CST. I am away on weekends (Saturday and Sunday) and if I've missed your post on or before a weekend after business hours please wait for the next following business day (Monday) and will get to your issue as soon as possible, thank you.
--
My role here is to provide guidance and assistance. I cannot provide custom code for each custom requirement. Please do not inquire me about custom development.
The following user(s) said Thank You: micheleq
Please Log in to join the conversation.
- micheleq
- OFFLINE
-
Elite Member
- Posts: 191
- Thanks: 22
- Karma: 5
6 months 1 week ago - 6 months 1 week ago #335493
by micheleq
Replied by micheleq on topic PayPal IPN random fails
Hi Kyle,
Thanks for your suggestion. Unfortunately, I'm still getting failed IPNs.
Here's what I did:
Starting with a fully clean table for Sunday I had:
So what now? Considering that the ones that fail continue to fail, I'd like to track those notification's process. Could you tell me which tables are written to and in what order when a notification comes in from PayPal? It seems to me, that given the error 500 and no logs, the problem should be early on, likely when writing to a table.
If you have any other ideas, I'm all ears.
Thank you,
Tomás
Thanks for your suggestion. Unfortunately, I'm still getting failed IPNs.
Here's what I did:
- Backed up the table as you said.
- deleted all records of the remaining table (without drooping the entire table)
- Converted all tables and records to uft8mb4_unicode_ci with the operations option in phpMyAdmin.
- errors with default values on dates being 000-00-00. Solved it by removing "strict mode" in MySQL
- Provinces in Aïn Defla - Algeria was throwing a duplicate error, which I solved by just adding a dot to the end of the Arabic characters. Did not see a duplicate to it, however, but it solved the issue.
- 17 Successful Payments: Gateway1: 11 - Gw2: 6 - Gw4: 0 (21 Entries in the notifications table)
- 3 Failed IPNs: Gateway1: 2 - Gw2: 0 - Gw4: 1
Starting with a fully clean table for Sunday I had:
- 5 Successful Payments: all Gateway 1 (16 entries in the Notifications table)
- 1 Failed IPNs from Gateway 4
So what now? Considering that the ones that fail continue to fail, I'd like to track those notification's process. Could you tell me which tables are written to and in what order when a notification comes in from PayPal? It seems to me, that given the error 500 and no logs, the problem should be early on, likely when writing to a table.
If you have any other ideas, I'm all ears.
Thank you,
Tomás
Last edit: 6 months 1 week ago by micheleq.
Please Log in to join the conversation.
- krileon
- Team Member
- OFFLINE
- Posts: 68555
- Thanks: 9095
- Karma: 1434
6 months 1 week ago #335500
by krileon
Kyle (Krileon)
Community Builder Team Member
Before posting on forums: Read FAQ thoroughly + Read our Documentation + Search the forums
CB links: Documentation - Localization - CB Quickstart - CB Paid Subscriptions - Add-Ons - Forge
--
If you are a Professional, Developer, or CB Paid Subscriptions subscriber and have a support issue please always post in your respective support forums for best results!
--
If I've missed your support post with a delay of 3 days or greater and are a Professional, Developer, or CBSubs subscriber please send me a private message with your thread and will reply when possible!
--
Please note I am available Monday - Friday from 8:00 AM CST to 4:00 PM CST. I am away on weekends (Saturday and Sunday) and if I've missed your post on or before a weekend after business hours please wait for the next following business day (Monday) and will get to your issue as soon as possible, thank you.
--
My role here is to provide guidance and assistance. I cannot provide custom code for each custom requirement. Please do not inquire me about custom development.
Replied by krileon on topic PayPal IPN random fails
I believe the table write order is as follows for a payment.
_cbsubs_notifications
_cbsubs_payments
_cbsubs_payment_baskets
_cbsubs_subscription
Throughout each of those the following will be written to.
_cbsubs_history
It's just incredibly strange it's happening so randomly. We've never had a test case of multiple PayPal accounts coming into a single CBSubs install as it was never designed for mutli-owner usage. What might be happening is 2 IPNs being processed at the exact same time because of this. Normally with a single PayPal account they all are queued and sent through properly timed. Looking at your timings above though that's not always the case so I'm not sure if that's what is doing it.
It might be time for us to completely rewrite the PayPal gateway to latest APIs. We're seeing strange reports as of late and wonder if PayPal is silently breaking their legacy API. Just doesn't make sense for something stable for years to just suddenly mess up.
_cbsubs_notifications
_cbsubs_payments
_cbsubs_payment_baskets
_cbsubs_subscription
Throughout each of those the following will be written to.
_cbsubs_history
It's just incredibly strange it's happening so randomly. We've never had a test case of multiple PayPal accounts coming into a single CBSubs install as it was never designed for mutli-owner usage. What might be happening is 2 IPNs being processed at the exact same time because of this. Normally with a single PayPal account they all are queued and sent through properly timed. Looking at your timings above though that's not always the case so I'm not sure if that's what is doing it.
It might be time for us to completely rewrite the PayPal gateway to latest APIs. We're seeing strange reports as of late and wonder if PayPal is silently breaking their legacy API. Just doesn't make sense for something stable for years to just suddenly mess up.
Kyle (Krileon)
Community Builder Team Member
Before posting on forums: Read FAQ thoroughly + Read our Documentation + Search the forums
CB links: Documentation - Localization - CB Quickstart - CB Paid Subscriptions - Add-Ons - Forge
--
If you are a Professional, Developer, or CB Paid Subscriptions subscriber and have a support issue please always post in your respective support forums for best results!
--
If I've missed your support post with a delay of 3 days or greater and are a Professional, Developer, or CBSubs subscriber please send me a private message with your thread and will reply when possible!
--
Please note I am available Monday - Friday from 8:00 AM CST to 4:00 PM CST. I am away on weekends (Saturday and Sunday) and if I've missed your post on or before a weekend after business hours please wait for the next following business day (Monday) and will get to your issue as soon as possible, thank you.
--
My role here is to provide guidance and assistance. I cannot provide custom code for each custom requirement. Please do not inquire me about custom development.
Please Log in to join the conversation.
Moderators: beat, nant, krileon
Time to create page: 0.311 seconds
-
You are here:
- Home
- Forums
- Support and Presales
- CB Paid Subscriptions Support
- PayPal IPN random fails