This project is mirrored from https://gitee.com/yxydde/incubator-kyuubi.git.
Pull mirroring failed .
Repository mirroring has been paused due to too many failed attempts. It can be resumed by a project maintainer.
Repository mirroring has been paused due to too many failed attempts. It can be resumed by a project maintainer.
- 01 Mar, 2022 4 commits
-
-
Fu Chen authored
### _Why are the changes needed?_ After [PR-1807](https://github.com/apache/incubator-kyuubi/pull/1807), the error will still occur. ``` 11:11:05.589 INFO org.apache.kyuubi.operation.log.OperationLog: Creating operation log file /Users/fchen/Project/bigdata/incubator-kyuubi/server_operation_logs/6a640069-6a26-4817-8ad7-77385360bb9d/a09d4b0a-85ec-4640-8ab9-c6a37146fd1f 11:11:05.603 INFO org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's query[a09d4b0a-85ec-4640-8ab9-c6a37146fd1f]: INITIALIZED_STATE -> PENDING_STATE, statement: LAUNCH_ENGINE 11:11:05.604 INFO org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's query[a09d4b0a-85ec-4640-8ab9-c6a37146fd1f]: PENDING_STATE -> RUNNING_STATE, statement: LAUNCH_ENGINE 11:11:25.075 INFO org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's query[a09d4b0a-85ec-4640-8ab9-c6a37146fd1f]: RUNNING_STATE -> FINISHED_STATE, statement: LAUNCH_ENGINE, time taken: 19.471 seconds 11:12:58.257 WARN org.apache.kyuubi.operation.KyuubiOperationManager: Operation OperationHandle [type=UNKNOWN_OPERATION, identifier: a09d4b0a-85ec-4640-8ab9-c6a37146fd1f] is timed-out and will be closed 11:12:58.258 INFO org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's query[a09d4b0a-85ec-4640-8ab9-c6a37146fd1f]: FINISHED_STATE -> CLOSED_STATE, statement: LAUNCH_ENGINE 11:13:04.615 INFO org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Received request of closing SessionHandle [6a640069-6a26-4817-8ad7-77385360bb9d] 11:13:04.618 INFO org.apache.kyuubi.session.KyuubiSessionManager: SessionHandle [6a640069-6a26-4817-8ad7-77385360bb9d] is closed, current opening sessions 0 11:13:04.619 ERROR org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Error closing session: org.apache.kyuubi.KyuubiSQLException: Invalid OperationHandle [type=UNKNOWN_OPERATION, identifier: a09d4b0a-85ec-4640-8ab9-c6a37146fd1f] at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69) ~[classes/:?] at org.apache.kyuubi.operation.OperationManager.removeOperation(OperationManager.scala:89) ~[classes/:?] at org.apache.kyuubi.operation.OperationManager.closeOperation(OperationManager.scala:104) ~[classes/:?] at org.apache.kyuubi.session.AbstractSession.$anonfun$closeOperation$1(AbstractSession.scala:181) ~[classes/:?] at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) ~[scala-library-2.12.15.jar:?] at org.apache.kyuubi.session.AbstractSession.withAcquireRelease(AbstractSession.scala:75) ~[classes/:?] at org.apache.kyuubi.session.AbstractSession.closeOperation(AbstractSession.scala:179) ~[classes/:?] at org.apache.kyuubi.session.KyuubiSessionImpl.close(KyuubiSessionImpl.scala:149) ~[classes/:?] at org.apache.kyuubi.session.SessionManager.closeSession(SessionManager.scala:93) ~[classes/:?] at org.apache.kyuubi.service.AbstractBackendService.closeSession(AbstractBackendService.scala:49) ~[classes/:?] at org.apache.kyuubi.server.KyuubiServer$$anon$1.org$apache$kyuubi$server$BackendServiceMetric$$super$closeSession(KyuubiServer.scala:142) ~[classes/:?] at org.apache.kyuubi.server.BackendServiceMetric.$anonfun$closeSession$1(BackendServiceMetric.scala:43) ~[classes/:?] at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) ~[scala-library-2.12.15.jar:?] at org.apache.kyuubi.metrics.MetricsSystem$.timerTracing(MetricsSystem.scala:111) ~[classes/:?] at org.apache.kyuubi.server.BackendServiceMetric.closeSession(BackendServiceMetric.scala:43) ~[classes/:?] at org.apache.kyuubi.server.BackendServiceMetric.closeSession$(BackendServiceMetric.scala:41) ~[classes/:?] at org.apache.kyuubi.server.KyuubiServer$$anon$1.closeSession(KyuubiServer.scala:142) ~[classes/:?] at org.apache.kyuubi.service.TFrontendService.CloseSession(TFrontendService.scala:158) [classes/:?] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$CloseSession.getResult(TCLIService.java:1397) [hive-service-rpc-2.3.9.jar:2.3.9] at org.apache.hive.service.rpc.thrift.TCLIService$Processor$CloseSession.getResult(TCLIService.java:1382) [hive-service-rpc-2.3.9.jar:2.3.9] at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38) [libthrift-0.16.0.jar:0.16.0] at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38) [libthrift-0.16.0.jar:0.16.0] at org.apache.kyuubi.service.authentication.TSetIpAddressProcessor.process(TSetIpAddressProcessor.scala:36) [classes/:?] at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:250) [libthrift-0.16.0.jar:0.16.0] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_202] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_202] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 11:13:04.629 INFO org.apache.kyuubi.server.KyuubiTBinaryFrontendService: Finished closing SessionHandle [6a640069-6a26-4817-8ad7-77385360bb9d] ``` ``` A => LaunchEngine Operation TCloseSessionReq A-PENDING A-FINISHED | Δ Δ | | | ▽ ----t1------t2------t3------t4------------------------------t5------------t6--------------t7-> | | | ▽ | ▽ A-INITIALIZED ▽ A-CLOSED (timed-out) A-RUNNING |<-- operation.idle.timeout -->|<-- operation.idle.timeout -->| ``` 1. the variable `LaunchEngine.lastAccessTime` will be reset to `System.currentTimeMillis()` when the operation is timeouts(at time t5). https://github.com/apache/incubator-kyuubi/blob/67d1c5dd513327b350dac3d6855af5223a594087/kyuubi-common/src/main/scala/org/apache/kyuubi/operation/AbstractOperation.scala#L75-L89 2. when the Kyuubi server receives the request TCloseSessionReq at time t6 between t5 and t7. Since t6 < t7, `LaunchEngine.isTimedOut()` will return false, and we will close the operation LaunchEngine again. https://github.com/apache/incubator-kyuubi/blob/67d1c5dd513327b350dac3d6855af5223a594087/kyuubi-common/src/main/scala/org/apache/kyuubi/operation/AbstractOperation.scala#L189-L196 ### _How was this patch tested?_ Pass CI. Closes #1983 from cfmcgrady/kyuubi-1806-followup. Closes #1983 Closes #1806 c7642693 [Fu Chen] Fix LaunchEngine may be closed multiple times Authored-by:
Fu Chen <cfmcgrady@gmail.com> Signed-off-by:
Cheng Pan <chengpan@apache.org>
-
Kent Yao authored
### _Why are the changes needed?_ ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1981 from yaooqinn/branch-dep. Closes #1981 07bf0e29 [Kent Yao] codec 96e41e7d [Kent Yao] codec 1da26432 [Kent Yao] guava 6cf0abb3 [Kent Yao] base64 & sha1 3b45ec2a [Kent Yao] base64 5490cfa7 [Kent Yao] http 6f4b48b8 [Kent Yao] n 2a87a4cf [Kent Yao] d a5ad3ccc [Kent Yao] Refine Deps in common module 24d5299e [Kent Yao] Refine Deps in common module Authored-by:
Kent Yao <yao@apache.org> Signed-off-by:
-
Wang Zhen authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> close #1972 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1982 from wForget/KYUUBI-1972. Closes #1972 2d83b245 [Wang Zhen] [KYUUBI-1972] Fix flaky test: SchedulerPoolSuite: Scheduler pool Authored-by:
Wang Zhen <wangzhen07@qiyi.com> Signed-off-by:
ulysses-you <ulyssesyou@apache.org>
-
Kent Yao authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> #1969 might be fixed by this. ``` 12:18:19.885 SparkTBinaryFrontendHandler-Pool: Thread-1260 INFO SparkSQLSessionManager: Session stopped due to shared level is Connection. 12:18:19.886 SparkTBinaryFrontendHandler-Pool: Thread-1260 INFO SparkSQLEngine: Service: [SparkTBinaryFrontend] is stopping. 12:18:19.886 SparkTBinaryFrontendHandler-Pool: Thread-1260 INFO SparkTBinaryFrontendService: SparkTBinaryFrontend has stopped 12:18:19.886 SparkTBinaryFrontendHandler-Pool: Thread-1260 INFO SparkTBinaryFrontendService: Service: [EngineServiceDiscovery] is stopping. 12:18:19.890 SparkTBinaryFrontendHandler-Pool: Thread-1260 DEBUG FailedDeleteManager: Path being added to guaranteed delete set: /kyuubi/CONNECTION/933147f8-1fcb-4cda-875f-0b219f97aaf3/serviceUri=localhost:43147;version=1.5.0-SNAPSHOT;sequence=0000000000 12:18:19.892 ProcessThread(sid:0 cport:40861): INFO PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x100000e6ac00000 type:delete cxid:0xb zxid:0x9 txntype:-1 reqpath:n/a Error Path:/kyuubi/CONNECTION/933147f8-1fcb-4cda-875f-0b219f97aaf3/serviceUri=localhost:43147;version=1.5.0-SNAPSHOT;sequence=0000000000 Error:KeeperErrorCode = NoNode for /kyuubi/CONNECTION/933147f8-1fcb-4cda-875f-0b219f97aaf3/serviceUri=localhost:43147;version=1.5.0-SNAPSHOT;sequence=0000000000 12:18:19.892 SyncThread:0 DEBUG FinalRequestProcessor: Processing request:: sessionid:0x100000e6ac00000 type:delete cxid:0xa zxid:0x8 txntype:2 reqpath:n/a 12:18:19.893 SparkTBinaryFrontendHandler-Pool: Thread-1260 ERROR ServiceDiscoveryClient: Failed to close the persistent ephemeral znodenull java.io.IOException: java.lang.InterruptedException at org.apache.curator.framework.recipes.nodes.PersistentNode.close(PersistentNode.java:296) ~[curator-recipes-2.12.0.jar:?] at org.apache.kyuubi.ha.client.zookeeper.ServiceDiscoveryClient.deregisterService(ServiceDiscoveryClient.scala:117) ~[kyuubi-ha_2.12-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT] at org.apache.kyuubi.ha.client.EngineServiceDiscovery.stop(EngineServiceDiscovery.scala:35) ~[kyuubi-ha_2.12-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT] at org.apache.kyuubi.service.CompositeService.$anonfun$stop$2(CompositeService.scala:75) ~[kyuubi-common_2.12-1.5.0-SNAPSHOT.jar:1.5.0-SNAPSHOT] ``` the deregister for connection-level happens in session close and SparkTBinaryFrontendHandler pool, which might be stopped before finish executing zk node deletion. this PR contains some other race issues too ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1980 from yaooqinn/conc. Closes #1969 efd12707 [Kent Yao] address comments aed6636f [Kent Yao] Fix race on some service during stop phase 63592621 [Kent Yao] Fix race on some service during stop phase Authored-by:
-
- 28 Feb, 2022 1 commit
-
-
Kent Yao authored
### _Why are the changes needed?_ remove dead and duplicated codes for kyuubi events ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1979 from yaooqinn/branch-events. Closes #1979 213bccd5 [Kent Yao] Simplify Events Code 1f20a1c9 [Kent Yao] Simplify Events Code 97a04dcd [Kent Yao] Simplify Events Code f326bb0d [Kent Yao] Simplify Events Code 47c6b8df [Kent Yao] Simplify Events Code b18f19ba [Kent Yao] Simplify Events Code 788b9e4e [Kent Yao] Simplify Events Code Authored-by:
-
- 24 Feb, 2022 5 commits
-
-
Cheng Pan authored
### _Why are the changes needed?_ Use the default Spark version to run TPC-DS test. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1975 from pan3793/tpcds. Closes #1975 ecdda1d9 [Cheng Pan] style 1e8468f4 [Cheng Pan] nit 9666cd8b [Cheng Pan] Update golden file 10b38939 [Cheng Pan] default spark version c1c9b037 [Cheng Pan] [BUILD] Run TPC-DS test using Spark 3.2 Authored-by:
-
Cheng Pan authored
### _Why are the changes needed?_ This PR aims to support auto merge small files in multi insert statement, for example `FROM VALUES(1) INSERT INTO tmp1 SELECT * INSERT INTO tmp2 SELECT *;` will generate the following plan, `Union` is the root node instead of `InsertIntoHiveTable` ``` Union :- InsertIntoHiveTable : +- Project : +- LocalRelation +- InsertIntoHiveTable +- Project +- LocalRelation ``` This PR also fixed the `canInsertRepartitionByExpression`, previous it did not consider the `SubqueryAlias` which may cause inserting error `Repartition`/`Reblance` node and currupt the data distribution, e.g. `FROM (SELECT * FROM VALUES(1) DOSTRIBUTE BY col1) INSERT INTO tmp1 SELECT * INSERT INTO tmp2 SELECT *;` ``` Union :- InsertIntoHiveTable : +- Project : +- SubqueryAlias : +- RepartitionByExpression : +- Project : +- LocalRelation +- InsertIntoHiveTable +- Project +- SubqueryAlias +- RepartitionByExpression +- Project +- LocalRelation ``` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1974 from pan3793/ext. Closes #1974 56cd7734 [Cheng Pan] nit e0155c27 [Cheng Pan] Support merge small files in multi table insertion Authored-by: -
SteNicholas authored
### _Why are the changes needed?_ Make plan only mode skippable for configuable plans. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1967 from SteNicholas/KYUUBI-1963. Closes #1963 e253aec6 [SteNicholas] [KYUUBI #1963] Make plan only mode skippable for configuable plans b5cff405 [SteNicholas] [KYUUBI #1963] Make plan only mode skippable for configuable plans Authored-by:
SteNicholas <programgeek@163.com> Signed-off-by:
-
Kent Yao authored
### _Why are the changes needed?_ Replace `mirror-cn` profile with Apache officially suggested dlcdn. mirror-cn is only suite for CN, while dlcdn is much wiser. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1970 from yaooqinn/cdn. Closes #1970 a325f828 [Kent Yao] Repalce mirror-cn profile with Apache officially suggested dlcdn a0756b4f [Kent Yao] Repalce mirror-cn profile with Apache officially suggested dlcdn Authored-by:
-
ulysses-you authored
### _Why are the changes needed?_ We have `TFramedTransport` in test of `kyuubi-extension-spark-common` and the `kyuubi-extension-spark-3-1` and `kyuubi-extension-spark-3-2` have already dependent on the test-jar of `kyuubi-extension-spark-common`. So it's redundant, and we can remove `TFramedTransport` in `kyuubi-extension-spark-3-1` and `kyuubi-extension-spark-3-2` ### _How was this patch tested?_ Pass CI Closes #1971 from ulysses-you/KYUUBI-1948-FOLLOWUP. Closes #1948 43193606 [ulysses-you] remove TFramedTransport in extension spark-3-1 and spark-3-2 Authored-by:
ulysses-you <ulyssesyou18@gmail.com> Signed-off-by:
-
- 23 Feb, 2022 3 commits
-
-
Kent Yao authored
### _Why are the changes needed?_ An SVG version of the Kyuubi logo has been uploaded to ASF svn repo, see https://www.apache.org/logos/?#kyuubi In this PR, we replace the one of png in the repo with it. Additionally, some badges that indicate how our repo is maintained are added to align the logo. ### _How was this patch tested?_ checked https://github.com/yaooqinn/incubator-kyuubi/tree/readme Closes #1965 from yaooqinn/readme. Closes #1965 1c8aef0c [Kent Yao] Use the newly added official logo at asf svn d8869fda [Kent Yao] Use the newly added official logo at asf svn a79b8a46 [Kent Yao] Use the newly added official logo at asf svn ece9c802 [Kent Yao] Use the newly added official logo at asf svn 9e009f9c [Kent Yao] Use the newly added official logo at asf svn 6aaad1ac [Kent Yao] Use the newly added official logo at asf svn Authored-by:
-
SteNicholas authored
### _Why are the changes needed?_ Upgrade libthrift to 0.16.0 due to [CVE-2020-13949](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-13949) and the coming upstream change of Spark https://github.com/apache/spark/pull/34362 ### _What changed in this PR?_ - Upgrade libthrift to 0.16.0 - Shade and relocate `thrift` and `hive-service-rpc` classes in `kyuubi-spark-engine`, it's necessary to avoide conflicting with old thrift libs bundled in Spark binary releases. - Due to thrift change the method signature, the subclasses those interfaces in Kyuubi also need to modify to pass compile. We rely on Hive 2.3.9 jars in some components, e.g. `kyuubi-hive-jdbc`, `LocalMetaServer` in `kyuubi-server` test classes. Some classes in Hive jars compiled against old thrift interfaces which are not compatible with thrift 0.16.0, it causes runtime link error, we found the following classes which breaks the test and copied them with necessary modification to make it work with thrift 0.16.0. - `TFramedTransport` - `TFilterTransport` - `TUGIAssumingTransport` - `TUGIContainingTransport` - Next Steps, I think it's worth to do in separated PRs. - Recover the `HiveDelegationTokenProviderSuite`, one approach is use an isolate classloader to load HMS classes and thrift 0.9.3 classes from Maven, this approach can also be used for the planed Zoopkeeper upgrading to help us verficating the compatibility of Zookeeper Server 3.4.x. - Rewrite `kyuubi-hive-jdbc` to make it decouple with Hive jars, because there maybe other places which may not work with thrift 0.16.0 but the UTs does not cover. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1953 from SteNicholas/KYUUBI-1948. Closes #1948 de5d1ea2 [SteNicholas] [KYUUBI #1948] Upgrade thrift version to 0.16.0 898effcd [SteNicholas] [KYUUBI #1948] Upgrade thrift version to 0.16.0 803e270c [SteNicholas] [KYUUBI #1948] Upgrade thrift version to 0.16.0 Authored-by:
-
Cheng Pan authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Hudi does not support Spark 3.2 yet. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1964 from pan3793/test. Closes #1964 cda19570 [Cheng Pan] [BUILD] Update scalatest.exclude.tags Authored-by:
-
- 22 Feb, 2022 6 commits
-
-
Paul Lin authored
### _Why are the changes needed?_ Currently, Flink engine would pull all result rows into memory before returning it to the client. This would be problematic for large result sets and infinite result sets. This is a sub-task of KPIP-2 https://github.com/apache/incubator-kyuubi/issues/1322. ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1938 from link3280/feature/FLINK-1883. Closes #1883 80020cee [Paul Lin] Update externals/kyuubi-flink-sql-engine/src/test/scala/org/apache/kyuubi/engine/flink/operation/FlinkOperationSuite.scala 1b958221 [Paul Lin] [KYUUBI #1883] Avoid allocating too much buffer space 5be7535c [Paul Lin] [KYUUBI #1883] Support max result rows for Flink queries Authored-by:
Paul Lin <paullin3280@gmail.com> Signed-off-by:
-
odone authored
Close #1920 ### _Why are the changes needed?_ ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1921 from iodone/kyuubi-1902. Closes #1920 79d7ba68 [odone] [KYUUBI #1920] Added CacheTableAsSelect to be skiped 571003de [odone] [KYUUBI #1920] Added CacheTableStatement to be skiped 889cb2b9 [odone] [KYUUBI #1920] Added CacheTableCommand and CreateView to be skiped 456dbf5f [odone] [KYUUBI #1920] Update test 90001690 [odone] [KYUUBI #1920] Update 80e0ceff [odone] [KYUUBI #1920] Update Authored-by:
odone <odone.zhang@gmail.com> Signed-off-by:
-
Fu Chen authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> close #1944 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1954 from cfmcgrady/kyuubi-1944. Closes #1944 2ce2f069 [Fu Chen] Upgrade Spark 3.1.3 Authored-by:
-
Kent Yao authored
### _Why are the changes needed?_ Make the `git log` pretty ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1957 from yaooqinn/merge. Closes #1957 95be6266 [Kent Yao] Skip html comments in merge commit test body from PR desc dfc8f2f8 [Kent Yao] Skip html comments in merge commit test body from PR desc 8b3eeffe [Kent Yao] Skip html comments in merge commit test body from PR desc Authored-by:
-
Kent Yao authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> 1. Add missing asf header 2. Disable fail-fast to let jobs run individually 3. Group defaults maven builds with java & spark version matrix - so this PR brings fully tests with JDK 11 back 4. Group others(now cross-version check only) in `include` 5. replace `actions/cachev2` with `actions/setup-javav2` - `cache: 'maven'` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Need to pass all CI jobs Closes #1947 from yaooqinn/ga. Closes #1947 7d5d2472 [Kent Yao] address comment d8d347b0 [Kent Yao] address comment 8c3cba99 [Kent Yao] address comment 7400cdc6 [Kent Yao] checkout 20eeb7bb [Kent Yao] test b1c70e42 [Kent Yao] test 4ca4f233 [Kent Yao] test b588cd32 [Kent Yao] test da4f6aea [Kent Yao] test 057790d5 [Kent Yao] test 01b07b25 [Kent Yao] test 2906ec66 [Kent Yao] test 4d97bf19 [Kent Yao] test cf16f169 [Kent Yao] test 8c12b8ef [Kent Yao] test 3b84e450 [Kent Yao] test 6e21d97a [Kent Yao] test dc2d9004 [Kent Yao] test 1cff392d [Kent Yao] test a4b47476 [Kent Yao] test c4718022 [Kent Yao] test d264d33d [Kent Yao] test ee293c13 [Kent Yao] test 903cb0bb [Kent Yao] test f74fa1a5 [Kent Yao] test Authored-by:
-
Kent Yao authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> The original idea of SPARK_HADOOP_VERSION is used to concat spark release names only, now we need to remove it as - SPARK_HADOOP_VERSION is misunderstood by developers and misused somewhere like the one of kyuubi compiled - multi-engine support now - the release names of spark(or something else) are very easy to get through code with different environments, prod/test/dev - A `mvn` job is bundled with `bin/load-kyuubi-env.sh` which is truly worrisome - SPARK_HADOOP_VERSION on spark side hass broken already for spark 3.2 which actually bundled with hadoop 3.3, see https://github.com/apache/spark-website/pull/361#discussion_r730716668 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1950 from yaooqinn/hadoop. Closes #1950 b47be7c6 [Kent Yao] Remove ambiguous SPARK_HADOOP_VERSION 3b33ee56 [Kent Yao] Remove ambiguous SPARK_HADOOP_VERSION Authored-by:
-
- 21 Feb, 2022 6 commits
-
-
Kent Yao authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Take spark as an example.  [link](https://mvnrepository.com/artifact/org.apache.spark/spark-core_2.13/3.2.1) ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1949 from yaooqinn/url. Closes #1949 f88c0598 [Kent Yao] [INFA] Add homepage for every module in maven cental 684f588f [Kent Yao] [INFA] Add homepage for every module in maven cental Authored-by:
-
Fei Wang authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> For kyuubi connection, if the launch engine operation fails, we need close the kyuubi connection. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1946 from turboFei/close_conn_on_engine_failure. Closes #1946 3a4a465a [Fei Wang] remove final: 81117268 [Fei Wang] add ut 74d3b28b [Fei Wang] address commments 0c41ac58 [Fei Wang] refactor 8dcc7ec1 [Fei Wang] Close the kyuubi connection on launch engine operation failure Authored-by:
Fei Wang <fwang12@ebay.com> Signed-off-by:
-
Martin Tzvetanov Grigorov authored
### _Why are the changes needed?_ More and more software development is being done on ARM64 CPU architecture. It would be good if Kyuubi is being regularly tested on Linux ARM64 (aarch64). ### _How was this patch tested?_ - [X] An additional job is added to the TravisCI config. Now the build will be executed on both AMD64 and ARM64 Closes #1918 from martin-g/build-on-linux-arm64. Closes #1918 4700c3ea [Martin Tzvetanov Grigorov] Remove the AMD64 build job bd3455bc [Martin Tzvetanov Grigorov] Test only kyuubi-common module at TravisCI a2019ec3 [Martin Grigorov] TravisCI: First install, then test 01e3b94a [Martin Tzvetanov Grigorov] Set Maven log level to WARN ee470b31 [Martin Tzvetanov Grigorov] Supress Maven network transfer progress 13e141cc [Martin Tzvetanov Grigorov] Dummy commit to trigger build at TravisCI 2b7f30d3 [Martin Tzvetanov Grigorov] Dummy commit to trigger build at TravisCI 1bf68dfd [Martin Tzvetanov Grigorov] Build and test on Linux ARM64 Lead-authored-by:
Martin Tzvetanov Grigorov <mgrigorov@apache.org> Co-authored-by:
Martin Grigorov <martin-g@users.noreply.github.com> Signed-off-by:
-
Cheng Pan authored
### _Why are the changes needed?_ Remove `spark-hadoop` from matrix to simplify workflow ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1945 from pan3793/ga. Closes #1945 3bd511eb [Cheng Pan] nit 442f61b9 [Cheng Pan] fix af26d6f6 [Cheng Pan] list b1e2fc78 [Cheng Pan] fix 9f372d13 [Cheng Pan] GA: Remove spark-hadoop from matrix to simplify workflow Authored-by:
-
Cheng Pan authored
### _Why are the changes needed?_ Currently, the UT failed in AArch64 JDK-17 with ``` EngineSecurityAccessorSuite: - test encrypt/decrypt, issue token/auth token *** FAILED *** java.security.NoSuchAlgorithmException: Cannot find any provider supporting AES/CTR/PKCS5PADDING at java.base/javax.crypto.Cipher.getInstance(Cipher.java:571) at org.apache.kyuubi.service.authentication.EngineSecurityAccessor.initializeForAuth(EngineSecurityAccessor.scala:43) at org.apache.kyuubi.service.authentication.EngineSecurityAccessor.<init>(EngineSecurityAccessor.scala:36) at org.apache.kyuubi.service.authentication.EngineSecurityAccessorSuite.$anonfun$new$2(EngineSecurityAccessorSuite.scala:34) at org.apache.kyuubi.service.authentication.EngineSecurityAccessorSuite.$anonfun$new$2$adapted(EngineSecurityAccessorSuite.scala:30) at scala.collection.immutable.List.foreach(List.scala:431) at org.apache.kyuubi.service.authentication.EngineSecurityAccessorSuite.$anonfun$new$1(EngineSecurityAccessorSuite.scala:30) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) ... Cause: javax.crypto.NoSuchPaddingException: CTR mode must be used with NoPadding at java.base/com.sun.crypto.provider.CipherCore.setPadding(CipherCore.java:300) at java.base/com.sun.crypto.provider.AESCipher.engineSetPadding(AESCipher.java:225) at java.base/javax.crypto.Cipher$Transform.setModePadding(Cipher.java:388) at java.base/javax.crypto.Cipher.getInstance(Cipher.java:564) at org.apache.kyuubi.service.authentication.EngineSecurityAccessor.initializeForAuth(EngineSecurityAccessor.scala:43) at org.apache.kyuubi.service.authentication.EngineSecurityAccessor.<init>(EngineSecurityAccessor.scala:36) at org.apache.kyuubi.service.authentication.EngineSecurityAccessorSuite.$anonfun$new$2(EngineSecurityAccessorSuite.scala:34) at org.apache.kyuubi.service.authentication.EngineSecurityAccessorSuite.$anonfun$new$2$adapted(EngineSecurityAccessorSuite.scala:30) at scala.collection.immutable.List.foreach(List.scala:431) at org.apache.kyuubi.service.authentication.EngineSecurityAccessorSuite.$anonfun$new$1(EngineSecurityAccessorSuite.scala:30) ... ``` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1940 from pan3793/encrypt. Closes #1940 527aa447 [Cheng Pan] [TEST] Fix EngineSecurityAccessorSuite Authored-by:
-
Cheng Pan authored
### _Why are the changes needed?_ We should also update `iceberg.name` when change the minor version of Spark ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1942 from pan3793/spark-3.2. Closes #1876 f178ceb8 [Cheng Pan] fix b0e79908 [Cheng Pan] nit a3f7e6f2 [Cheng Pan] [KYUUBI #1876] [FOLLOWUP] Update iceberg.name Authored-by:
-
- 20 Feb, 2022 2 commits
-
-
Cheng Pan authored
### _Why are the changes needed?_ Follow up #1876 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1937 from pan3793/ga. Closes #1937 e6794cbf [Cheng Pan] Build: Use Spark 3.2 for cross version verfication Authored-by:
-
Cheng Pan authored
### _Why are the changes needed?_ https://github.com/jacoco/jacoco/releases Currently, the UT failed in AArch64 JDK-17 with ``` Caused by: java.lang.IllegalArgumentException: Unsupported class file major version 61 at org.jacoco.agent.rt.internal_f3994fa.asm.ClassReader.<init>(ClassReader.java:196) at org.jacoco.agent.rt.internal_f3994fa.asm.ClassReader.<init>(ClassReader.java:177) at org.jacoco.agent.rt.internal_f3994fa.asm.ClassReader.<init>(ClassReader.java:163) at org.jacoco.agent.rt.internal_f3994fa.core.internal.instr.InstrSupport.classReaderFor(InstrSupport.java:280) at org.jacoco.agent.rt.internal_f3994fa.core.instr.Instrumenter.instrument(Instrumenter.java:76) at org.jacoco.agent.rt.internal_f3994fa.core.instr.Instrumenter.instrument(Instrumenter.java:108) ... 105 more ``` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1939 from pan3793/jacoco. Closes #1939 6a57c092 [Cheng Pan] Build: Bump Jacoco maven plugin 0.8.7 Authored-by:
-
- 18 Feb, 2022 5 commits
-
-
Wang Zhen authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Destroy the process after the engine starts. #1796 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [X] Add screenshots for manual tests if appropriate add conf: `kyuubi.session.engine.startup.waitCompletion false`  - [X] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1815 from wForget/KYUUBI-1796. Closes #1796 12aea19a [Wang Zhen] fix 27cb602a [Wang Zhen] fix e70e7071 [Wang Zhen] add log ecaf828c [Wang Zhen] regenerate settings.md a5f6c5de [Wang Zhen] fix desc 09812beb [Wang Zhen] Merge remote-tracking branch 'origin/master' into KYUUBI-1796 27fab5eb [Wang Zhen] [KYUUBI-1796] Destroy the process after the engine starts Authored-by:
-
SteNicholas authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> `AbstractSession._lastIdleTime` should be reset in acquire method. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1934 from SteNicholas/KYUUBI-1931. Closes #1931 cbbd92eb [SteNicholas] [KYUUBI #1931] AbstractSession._lastIdleTime should be reset in acquire method. Authored-by:
-
SteNicholas authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Add more enum values for `OperationModes`. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1933 from SteNicholas/KYUUBI-1919. Closes #1919 adcc7f5e [SteNicholas] [KYUUBI #1919] Add more enum values for OperationModes Authored-by:
-
hongdongdong authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [X] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1932 from hddong/add-trino-engine-home. Closes #1930 26ed8ce2 [root] [KYUUBI #1930] Export TRINO_ENGINE_HOME in load-kyuubi-env script Lead-authored-by:
hongdongdong <hongdongdong@cmss.chinamobile.com> Co-authored-by:
root <root@DESKTOP-30EIBMO.localdomain> Signed-off-by:
-
yanghua authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1927 from yanghua/KYUUBI-1926. Closes #1926 3e82abb4 [yanghua] [KYUUBI #1926] Remove useless constants in Constants Authored-by:
yanghua <yanghua1127@gmail.com> Signed-off-by:
-
- 17 Feb, 2022 3 commits
-
-
SteNicholas authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Add GetFunctions for trino engine. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1925 from SteNicholas/KYUUBI-1923. Closes #1923 4ebc64ae [SteNicholas] [KYUUBI #1923] Add GetFunctions for trino engine f19f5188 [SteNicholas] [KYUUBI #1923] Add GetFunctions for trino engine ac9df0a8 [SteNicholas] [KYUUBI #1923] Add GetFunctions for trino engine Authored-by:
-
SteNicholas authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Add GetColumns for trino engine. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1922 from SteNicholas/KYUUBI-1906. Closes #1906 e7ff09b9 [SteNicholas] [KYUUBI #1906] Add GetColumns for trino engine Authored-by:
-
zhenjiaguo authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Update metric doc when metric change. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [x] Add screenshots for manual tests if appropriate  - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1916 from zhenjiaguo/update_metric_doc. Closes #1914 e8ea7f6c [zhenjiaguo] update metric doc a5d730ce [zhenjiaguo] update metric doc Authored-by:
zhenjiaguo <zhenjiaguo@gmail.com> Signed-off-by:
-
- 16 Feb, 2022 2 commits
-
-
SteNicholas authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ Support `PlanOnlyStatement` operation like Spark SQL engine. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1891 from SteNicholas/KYUUBI-1867. Closes #1867 beacaf76 [SteNicholas] [KYUUBI #1867] Bugfix FlinkSQLSessionManager should open Flink session f3797076 [SteNicholas] [KYUUBI #1867] Support PlanOnlyStatement operation like Spark SQL engine Authored-by:
-
SteNicholas authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Add GetTypeInfo for trino engine. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1912 from SteNicholas/KYUUBI-1911. Closes #1911 33a4dff8 [SteNicholas] [KYUUBI #1911] Add GetTypeInfo for trino engine Authored-by:
-
- 15 Feb, 2022 3 commits
-
-
SteNicholas authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> Set Spark 3.2.1 as default. ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [x] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1913 from SteNicholas/KYUUBI-1876. Closes #1876 1a6e4c6c [SteNicholas] [KYUUBI #1876] Set Spark 3.2.1 as default Authored-by:
-
ulysses-you authored
<!-- Thanks for sending a pull request! Here are some tips for you: 1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html 2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'. 3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'. --> ### _Why are the changes needed?_ <!-- Please clarify why the changes are needed. For instance, 1. If you add a feature, you can talk about the use case of it. 2. If you fix a bug, you can clarify why it is a bug. --> closes https://github.com/apache/incubator-kyuubi/issues/1536 ### _How was this patch tested?_ - [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1892 from ulysses-you/KYUUBI-1536. Closes #1536 f0c450a9 [ulysses-you] codecov 35fac4f6 [ulysses-you] fix f34cfbf4 [ulysses-you] comment 78a54bc1 [ulysses-you] address comment 5cb574ba [ulysses-you] fix test 1033909b [ulysses-you] fix 3c925e56 [ulysses-you] address comment a74988cd [ulysses-you] style 649f02d0 [ulysses-you] Add session conf advisor debd3adb [ulysses-you] Add session conf advisor Authored-by:
-
Cheng Pan authored
### _Why are the changes needed?_ Bump Iceberg 0.13.1 ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.apache.org/docs/latest/develop_tools/testing.html#running-tests ) locally before make a pull request Closes #1899 from pan3793/iceberg. Closes #1899 840c0a7f [Cheng Pan] Remove staging repo 4bbd48f8 [Cheng Pan] Remove workaround 9ec37fde [Cheng Pan] Bump Iceberg 0.13.1 Lead-authored-by:
Cheng Pan <379377944@qq.com> Signed-off-by:
-
