Integrations

Bitbucket pipelines

Overview

This document provides a comprehensive guide to integrating Bitbucket Pipelines with Callgoose SQIBS for real-time incident management, incident auto-remediation, event-driven automation, and other automation purposes. The integration allows for the automatic creation, updating, and resolution of incidents in Callgoose SQIBS based on events triggered in Bitbucket Pipelines. The guide covers steps for configuring Bitbucket Pipelines events, setting up webhook notifications, creating API filters in Callgoose SQIBS, and troubleshooting common issues.

Prerequisites

Bitbucket Account: Access to Bitbucket Pipelines for configuring webhooks and managing pipelines.
Callgoose SQIBS Account: With valid privileges to set up API filters and receive notifications.
Webhook/API Endpoint: Available in Callgoose SQIBS to receive alerts from Bitbucket Pipelines.

1. Obtain API Token and Endpoint Details

To integrate with Callgoose SQIBS, you first need to obtain an API token and find the API endpoint details.

Generate an API Token:
Follow the guide on How to Create API Token in Callgoose SQIBS.
Find the API Endpoint:
Refer to the Callgoose SQIBS API Endpoint Documentation to get the endpoint details where the JSON payloads from Bitbucket Pipelines will be sent.

2. Debugging and Troubleshooting

You can enable debugging in the API tokens used with Bitbucket Pipelines notifications for troubleshooting purposes.

Enable Debugging:
You can update the debug value when adding or updating an API token.
When API tracking is enabled, logs are stored in the API log section for your review. The debugging option will automatically disable after 48 hours.
When API tracking is turned off, no logs are saved in the API log.
Using API Log for Troubleshooting:
The API log provides detailed information on all API calls made to Callgoose SQIBS.
You can check the JSON values in each API log entry for troubleshooting purposes.
Use the information in the API log to create or refine API filters to ensure incidents are created correctly based on the API payloads received.
Callgoose SQIBS creates incidents according to your API filter configuration, giving you full control over how alerts from different services trigger incidents and alerts for your support team or automation processes.

3. Configuring Bitbucket Pipelines to Send JSON Payloads

To configure Bitbucket Pipelines to generate the JSON payloads, follow the steps outlined below. These steps will guide you through setting up the necessary events and webhook notifications within Bitbucket Pipelines to ensure that the JSON payloads match those expected by Callgoose SQIBS.

3.1 Setting Up Events in Bitbucket Pipelines

To generate the required JSON payloads, you first need to set up events within Bitbucket Pipelines.

Log in to the Bitbucket Console:
Access the Bitbucket platform using your account credentials.
Navigate to your Repository:
In the Bitbucket console, go to the repository where you want to configure the pipeline events.
Create a New Pipeline:
Click on pipelines to create a new pipeline or configure an existing one. Refer Bitbucket Pipelines for more info.

3.2 Configure the Notification Method

After configuring pipelines, Navigate to repostiory settings and click on Webhooks.
Click on Add Webhook.
Provide the title for the webhook.
In the URL field provide the API endpoint URL from Callgoose SQIBS. Refer to the API Endpoint documentation for more details on selecting the final endpoint format.
Choose which events will trigger the webhook (e.g., Build status created, Build status updated etc.).
Please refer to Bitbucket event payloads for properly configuring triggers.
Save the webhook.

3.3 Finalizing and Testing

Validate the Integration:
Trigger the event condition manually if possible to verify that the correct JSON payload is sent to Callgoose SQIBS.
Review the payload in Callgoose SQIBS to confirm that it matches the expected structure.

4. Configuring Callgoose SQIBS

4.1 Create API Filters in Callgoose SQIBS

To correctly map incidents from the Bitbucket Pipelines events, you need to create API filters based on the JSON payloads received.

4.1.1 Example JSON Payloads from Bitbucket Pipelines

Build Event Triggered (state: "FAILED"):

json

{
  "repository": {
    "type": "repository",
    "full_name": "****/test",
    "links": {
      "self": {
        "href": "https://api.bitbucket.org/2.0/repositories/****/test"
      },
      "html": {
        "href": "https://bitbucket.org/****/test"
      },
      "avatar": {
        "href": "https://bytebucket.org/ravatar/%****"
      }
    },
    "name": "Test",
    "scm": "git",
    "website": null,
    "owner": {
      "display_name": "****",
      "links": {
        "self": {
          "href": "https://api.bitbucket.org/2.0/workspaces/%****"
        },
        "avatar": {
          "href": "https://bitbucket.org/account/****/avatar/"
        },
        "html": {
          "href": "https://bitbucket.org/%****/"
        }
      },
      "type": "team",
      "uuid": "{ff0d012a-6c0d-43d5-91b2-c0bedce333a0}",
      "username": "****"
    },
    "workspace": {
      "type": "workspace",
      "uuid": "{ff0d012a-6c0d-43d5-91b2-c0bedce333a0}",
      "name": "****",
      "slug": "****",
      "links": {
        "avatar": {
          "href": "https://bitbucket.org/workspaces/****/avatar/?ts=1725537423"
        },
        "html": {
          "href": "https://bitbucket.org/****/"
        },
        "self": {
          "href": "https://api.bitbucket.org/2.0/workspaces/****"
        }
      }
    },
    "is_private": true,
    "project": {
      "type": "project",
      "key": "TEST",
      "uuid": "{66f8b7e4-6762-45b5-8dd4-2d9198061517}",
      "name": "Test",
      "links": {
        "self": {
          "href": "https://api.bitbucket.org/2.0/workspaces/****/projects/TEST"
        },
        "html": {
          "href": "https://bitbucket.org/****/workspace/projects/TEST"
        },
        "avatar": {
          "href": "https://bitbucket.org/account/user/****/projects/TEST/avatar/32?ts=1725537837"
        }
      }
    },
    "uuid": "{5f0b47eb-3256-46e1-8820-bbe6ca90bac6}",
    "parent": null
  },
  "actor": {
    "display_name": "****",
    "links": {
      "self": {
        "href": "https://api.bitbucket.org/2.0/workspaces/%****"
      },
      "avatar": {
        "href": "https://bitbucket.org/account/****/avatar/"
      },
      "html": {
        "href": "https://bitbucket.org/%****/"
      }
    },
    "type": "team",
    "uuid": "{ff0d012a-6c0d-43d5-91b2-c0bedce333a0}",
    "username": "****"
  },
  "commit_status": {
    "key": "1032085721",
    "type": "build",
    "state": "FAILED",
    "name": "Pipeline #39 for ****/webhook-testing-1725613614059",
    "refname": "****/webhook-testing-1725613614059",
    "commit": {
      "type": "commit",
      "hash": "****",
      "date": "2024-09-06T09:44:34+00:00",
      "author": {
        "type": "author",
        "raw": "**** <****@gmail.com>",
        "user": {
          "display_name": "Lloyd Sebastian",
          "links": {
            "self": {
              "href": "https://api.bitbucket.org/2.0/users/****"
            },
            "avatar": {
              "href": "https://secure.gravatar.com/avatar/****"
            },
            "html": {
              "href": "https://bitbucket.org/****/"
            }
          },
          "type": "user",
          "uuid": "{376798d2-b761-44a1-a848-48fc38844977}",
          "account_id": "712020:c214d151-eb13-4897-a235-62fa04b711cd",
          "nickname": "Lloyd Sebastian"
        }
      },
      "message": "Testing",
      "links": {
        "self": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****"
        },
        "html": {
          "href": "https://bitbucket.org/****/test/commits/****"
        },
        "diff": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/diff/****"
        },
        "approve": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****/approve"
        },
        "comments": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****/comments"
        },
        "statuses": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****/statuses"
        },
        "patch": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/patch/****"
        }
      }
    },
    "url": "https://bitbucket.org/****/test/addon/pipelines/home#!/results/39",
    "repository": {
      "type": "repository",
      "full_name": "****/test",
      "links": {
        "self": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test"
        },
        "html": {
          "href": "https://bitbucket.org/****/test"
        },
        "avatar": {
          "href": "https://bytebucket.org/ravatar/%****"
        }
      },
      "name": "Test",
      "uuid": "{5f0b47eb-3256-46e1-8820-bbe6ca90bac6}"
    },
    "description": "",
    "created_on": "2024-09-06T09:44:40.076775+00:00",
    "updated_on": "2024-09-06T09:48:35.723723+00:00",
    "links": {
      "self": {
        "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****/statuses/build/1032085721"
      },
      "commit": {
        "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****"
      }
    }
  }
}

Build Event Resolved (state: "SUCCESSFUL"):

json

{
  "repository": {
    "type": "repository",
    "full_name": "****/test",
    "links": {
      "self": {
        "href": "https://api.bitbucket.org/2.0/repositories/****/test"
      },
      "html": {
        "href": "https://bitbucket.org/****/test"
      },
      "avatar": {
        "href": "https://bytebucket.org/ravatar/****"
      }
    },
    "name": "Test",
    "scm": "git",
    "website": null,
    "owner": {
      "display_name": "****",
      "links": {
        "self": {
          "href": "https://api.bitbucket.org/2.0/workspaces/****"
        },
        "avatar": {
          "href": "https://bitbucket.org/account/****/avatar/"
        },
        "html": {
          "href": "https://bitbucket.org/****/"
        }
      },
      "type": "team",
      "uuid": "{ff0d012a-6c0d-43d5-91b2-c0bedce333a0}",
      "username": "****"
    },
    "workspace": {
      "type": "workspace",
      "uuid": "{ff0d012a-6c0d-43d5-91b2-c0bedce333a0}",
      "name": "****",
      "slug": "****",
      "links": {
        "avatar": {
          "href": "https://bitbucket.org/workspaces/****/avatar/?ts=1725537423"
        },
        "html": {
          "href": "https://bitbucket.org/****/"
        },
        "self": {
          "href": "https://api.bitbucket.org/2.0/workspaces/****"
        }
      }
    },
    "is_private": true,
    "project": {
      "type": "project",
      "key": "TEST",
      "uuid": "{66f8b7e4-6762-45b5-8dd4-2d9198061517}",
      "name": "Test",
      "links": {
        "self": {
          "href": "https://api.bitbucket.org/2.0/workspaces/****/projects/TEST"
        },
        "html": {
          "href": "https://bitbucket.org/****/workspace/projects/TEST"
        },
        "avatar": {
          "href": "https://bitbucket.org/account/user/****/projects/TEST/avatar/32?ts=****"
        }
      }
    },
    "uuid": "{5f0b47eb-3256-46e1-8820-bbe6ca90bac6}",
    "parent": null
  },
  "actor": {
    "display_name": "****",
    "links": {
      "self": {
        "href": "https://api.bitbucket.org/2.0/workspaces/****"
      },
      "avatar": {
        "href": "https://bitbucket.org/account/****/avatar/"
      },
      "html": {
        "href": "https://bitbucket.org/****/"
      }
    },
    "type": "team",
    "uuid": "{ff0d012a-6c0d-43d5-91b2-c0bedce333a0}",
    "username": "****"
  },
  "commit_status": {
    "key": "****",
    "type": "build",
    "state": "SUCCESSFUL",
    "name": "Pipeline #40 for ****/webhook-testing-1725613614059",
    "refname": "****/webhook-testing-1725613614059",
    "commit": {
      "type": "commit",
      "hash": "****",
      "date": "2024-09-06T09:50:34+00:00",
      "author": {
        "type": "author",
        "raw": "**** <****@gmail.com>",
        "user": {
          "display_name": "****",
          "links": {
            "self": {
              "href": "https://api.bitbucket.org/2.0/users/****"
            },
            "avatar": {
              "href": "https://secure.gravatar.com/avatar/****"
            },
            "html": {
              "href": "https://bitbucket.org/****/"
            }
          },
          "type": "user",
          "uuid": "{376798d2-b761-44a1-a848-48fc38844977}",
          "account_id": "712020:c214d151-eb13-4897-a235-62fa04b711cd",
          "nickname": "****"
        }
      },
      "message": "Testing",
      "links": {
        "self": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****"
        },
        "html": {
          "href": "https://bitbucket.org/****/test/commits/****"
        },
        "diff": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/diff/****"
        },
        "approve": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****/approve"
        },
        "comments": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****/comments"
        },
        "statuses": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****/statuses"
        },
        "patch": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test/patch/****"
        }
      }
    },
    "url": "https://bitbucket.org/****/test/addon/pipelines/home#!/results/40",
    "repository": {
      "type": "repository",
      "full_name": "****/test",
      "links": {
        "self": {
          "href": "https://api.bitbucket.org/2.0/repositories/****/test"
        },
        "html": {
          "href": "https://bitbucket.org/****/test"
        },
        "avatar": {
          "href": "https://bytebucket.org/ravatar/****"
        }
      },
      "name": "Test",
      "uuid": "{5f0b47eb-3256-46e1-8820-bbe6ca90bac6}"
    },
    "description": "",
    "created_on": "2024-09-06T09:50:38.682140+00:00",
    "updated_on": "2024-09-06T09:51:08.466651+00:00",
    "links": {
      "self": {
        "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****/statuses/build/****"
      },
      "commit": {
        "href": "https://api.bitbucket.org/2.0/repositories/****/test/commit/****"
      }
    }
  }
}

Note: These example are of triggers: build status created and updated. Callgoose SQIBS will receive payload as per the triggers you configured in the Bitbucket pipelines.

4.2 Configuring API Filters

4.2.1 Integration Templates

If you see a Bitbucket Pipelines integration template in the "Select Integration Template" dropdown in the API filter settings, you can use it to automatically add the necessary Trigger and Resolve filters along with other values. The values added by the template can be modified to customize the integration according to your requirements.

4.2.2 Manually Add/Edit the Filter

Trigger Filter (For Creating Incidents):
Payload JSON Key: "commit_status"."state"
Key Value Contains: [FAILED]
Map Incident With: "repository"."owner"."username"
Incident Title From: "commit_status"."name""
This will use the commit status name as the incident title in Callgoose SQIBS.
You can also configure the API endpoint URL from Callgoose Sqibs using the 'from' URL parameter. The 'from' parameter value will be used if the payload does not contain the specific Incident title key specified in the API filter. Refer to the API endpoint documentation for more details.
Incident Description From: Leave this empty unless you want to use a specific key-value from the JSON payload. If a key is entered, only the value for that key will be used as the Incident Description instead of the full JSON. By default, the Incident Description will include the full JSON values.
Example: If you use the "commit_status"."commit"."message" key in the Incident Description From field, the incident message will be the value of the "description" key. In the example JSON payload provided earlier, this would result in a description like "Testing".
Resolve Filter (For Resolving Incidents):
Payload JSON Key: "commit_status"."state"
Key Value Contains: [SUCCESSFUL]
Incident Mapped With: "repository"."owner"."username"
Note: For different trigger you should configure the API filter according to the payload you receive from bitbucket. This example is for the triggers Build status created and Build status updated.

Refer to the API Filter Instructions and FAQ for more details.

4.3 Finalizing Setup

Save the API Filters:
Ensure that the filters are correctly configured and saved in Callgoose SQIBS.
Double-check that all key mappings, incident titles, and descriptions are correctly aligned with the payload structure sent by Bitbucket Pipelines.

5. Testing and Validation

5.1 Triggering Events

Simulate a Pipeline Event:
Trigger a condition in Bitbucket Pipelines that causes an event (e.g., a failed build or deployment).
Verify that an incident is created in Callgoose SQIBS with the correct information.

5.2 Resolving Events

Acknowledge and Resolve the Event:
Once the issue is resolved in Bitbucket Pipelines (e.g., a successful build or deployment after a failure), verify that the incident in Callgoose SQIBS is automatically marked as resolved.

6. Security Considerations

API Security: Ensure that the Callgoose SQIBS API endpoint is correctly configured and that the API token is securely stored and used.
Bitbucket Pipelines Permissions: Confirm that the webhook in Bitbucket Pipelines has appropriate permissions to send events and data to Callgoose SQIBS.

7. Troubleshooting

No Incident Created: If no incident is created, verify that the webhook URL in Bitbucket Pipelines is correct and that the JSON payload structure matches the API filters configured in Callgoose SQIBS.

8. Conclusion

This guide provides a comprehensive overview of how to integrate Bitbucket Pipelines with Callgoose SQIBS for effective incident management. By following the steps outlined, you can ensure that events from Bitbucket Pipelines are automatically reflected as incidents in Callgoose SQIBS, with proper resolution tracking when the issues are resolved.

For further customization or advanced use cases, refer to the official documentation for both Bitbucket Pipelines and Callgoose SQIBS:

This documentation will guide you through the integration process, ensuring that your incidents are managed effectively within Callgoose SQIBS based on real-time events from Bitbucket Pipelines.