user avatar
[Backport release-1.6] Feat: implement pipeline APIs (#4969)
github-actions[bot] authored
* add context when run pipeline
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 72f3ad792ef6d0f7c05a89341e02a8bf2a33ee26)

* Feat: implement pipeline API
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit f560c346cc4424a1c782615a42da85cb81da5663)

* Extract get log logic and implement getPipelineRunLog API
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 060c6ab9e96a01d8e1230de5d25c1f5215cd96f8)

* Init and delete pipeline contexts
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 5e96bd31066960160977397decbbd12e08bbb1b1)

* fix panic
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 51072f7947f86594b4c32854c20e2c9580a70a21)

* Allow not specifying context
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 810ddcf0bdd98dfceee8aa6f86c283da7db9f3b0)

* change pipeline to path parameter
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 3d51c0cb2db9ca364884de539bcfc3fa27553e26)

* Add permission check filter
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 688376743040f9903bdce9af66949f6424946089)

* project -> projects in route
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 1f09f3996bf6953dc07f2b778314a238ec516836)

* fix route conflict
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 7eea69683048639ebd5d1efd362adf05d3c80bf8)

* Add project alias
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit b07dd72338f376c53522bed5d58c331449659f1a)

* Feat: change the list pipeline API
Signed-off-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
(cherry picked from commit bd804734b0bfa71ed59c26613c9ecb2094a0a3d5)

* Feat: filter the project
Signed-off-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
(cherry picked from commit 82eee2cc113862bcd6db589875dfdc99d7e2bf69)

* Fix: the error of the run APi
Signed-off-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
(cherry picked from commit ac87bd3f1a2eeaf5caafe6cfb8d7e7e3992d2a2b)

* fix log pipeline run API
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit acde8e981e9003a81ffa91f9e72776f29e275654)

* Fix lint, fix the error of log api
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit b8373e6cde596557976fc1d26feca4badd8fd264)

* fix error returning
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 2e9b4792b06cac89e6a42f6d64c80eb09a30431d)

* Fix: change the lable to annotation
Signed-off-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
(cherry picked from commit bf08275fde2f1aa7dd7c0a80ebb2ec74ced61617)

* remove log config not found error
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit cdd77dfd8fa5f32e3622c139fd51cead550742ed)

* fix pipeline list api return no context info
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit cdcfa165d16d355d0a6210357e4f13e678c620d9)

* Fix: create the namespace
Signed-off-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
(cherry picked from commit b6888dd87d7c2032c448ef77f570a5db57507409)

* get pipeline lastrun info
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit a943423d22c7bbbe3cfee1d98a7a4516258f6895)

* allow query single step output
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit e2310bbf34f20063917b6bba7999aa2328bc4a5c)

* organize code in api layer
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 6fd53ed078e6d3dd965e86e32c41abea50c50a44)

* fix project filter, add context value when get pp run, extend lastRun
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 861f69d555fc443a153c7e14c28897f40773b8b4)

* fix get output and implement get input api
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 61495ee70dbcd928f4749807adc635fad3b1f857)

* Fix: change the last run
Signed-off-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
(cherry picked from commit aeb842a45ea7c8a81aa75770a5e54ec1eb5cdaed)

* if query sub-step outout, return it directly
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 467ba257511662d3a688b2a27489dd7939e151ef)

* Fix: change the run stats
Signed-off-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
(cherry picked from commit 7a90e7e310181f5ec4ca60be1f7f4cb14b4e0a68)

* Fix: change the output
Signed-off-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
(cherry picked from commit 595a871b0d3aa39cf939cee1ffe6dbefa78dbf57)

* flatten the input/output api
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit efc9692354c21408c61f26e55d07a223778efa1e)

* more info for i/o vars
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 7fe0e1109cd0544d19cf432e885fab579490d9bf)

* fix nested i/o struct
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 201d1228bdc9e74ac85909f9fd05ce7cb5ed6441)

* add fromStep in input api
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 240001896289f7d9261bd590b17b9c6e75801cbb)

* add e2e test skeleton
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit f20f9a1ac67bbdc078a8a941809e207014d5c145)

* add more e2e test
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 98b27f886b0db09509381f12b76948f74567dcaa)

* use db to store pipeline
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 08962c4f2f61ea09e3cb9a40f8f92a723e5e7309)

* keep the last 5k lines of log
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 22b352da146b42465c790fcb927889f10f0cad0d)

* use stern param to keep last lines of logs
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 3eadbf91c818092d02948bbe4798360121e6079e)

* filter, nil labels, spec check
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit bad90b3f7a343647b39af2a8dd6dd8b101562dab)

* empty res, index, detail param
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit b12d889e978b4f0936a83c76010701c94e314323)

* Add e2e test
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit ae617a928ef0250708f478b944675dcce078c1ff)

* fix e2e test and unit test
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 0f4e030b84e9bb08697277cafb1116fcf499af72)

* add context e2e test
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 88879e6e43f986cb59d4430903305230d30f27d5)

* goimports
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 58429978b3c79983ec5baf3851c2bcac9595a4b2)

* add more test
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 75760521a460d881d206739fb1c33ccd5884f50c)

* review
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit cc4c7064667d9a7d5cbe3d36a0946cb0413edc77)

* remove optional tag in returned value, unify the imports name
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 658b184aef656cf4d611fddf09028b5a3e45d070)

* fix e2e test
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit a9e9c96856892b7394f77eeb6cb19fe7cb3552e3)

* add stop test
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 58aa2e5125b44fb26a3fe25d36d5a1f1859df480)

* more coverage
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 01ecb513233ac6015e09182abef00f92e2a491fe)

* single case selct
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit d9e8fd03426c811d741dff5567642f5d42f0ad3f)

* optimize log color
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit be9840c3cb0d4893708a40b778a500d90f941629)

* add default permission and role
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit cf074444ac51f7dd13131360f3f8dd695307927e)

* fix permission ut
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 1bdcad63a2128f6ace72825182d600451ef8cf99)

* change the log api implementation
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 587f745430d4f6d6655b7dc84f71a255a147ff49)

* add color, add container order
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 6e7f18760585bb5f9d07551ef0e00d8fc21c03b6)

* lint
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 64ba029031c6d8b1e13dea16544d561740e8f976)

* fix filter nil will cut all log
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 799dfe377ad8ba3b4868c93ea5b98427c2be5fed)

* longer timeout and lint
Signed-off-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
(cherry picked from commit 89873f1f66d167507da710c394b79f3f542b60ff)
Co-authored-by: default avatarQiaozp <qiaozhongpei.qzp@alibaba-inc.com>
Co-authored-by: default avatarbarnettZQG <barnett.zqg@gmail.com>
0736e85e
Name Last commit Last update
..