Jack Ma, 马云(馬雲), 마윈

 





댓글

댓글 쓰기

이 블로그의 인기 게시물

Delete topic on Kafka, 카프카 토픽 삭제하기

To delete a topic in Kafka, you need to ensure that the Kafka cluster is properly configured to allow topic deletions and then execute the deletion command. Here's a step-by-step guide on how to do this: 1. Enable Topic Deletion in Kafka (if not already enabled) By default, Kafka does not always enable topic deletion. You need to ensure that the Kafka broker has the following setting in the configuration file ( server.properties ): delete .topic .enable =true This setting allows topics to be deleted. If it is set to false , topic deletion will not work. You must restart the Kafka broker after making this change. 2. Delete a Topic Using Kafka Command-Line Tools Once topic deletion is enabled, you can delete a Kafka topic using the Kafka command-line tool ( kafka-topics.sh or kafka-topics.bat for Windows). Example: $ kafka-topics. sh --bootstrap-server localhos t:9092 -- delete --topic <topic_name> Replace <topic_name> with the actual name of the topic you...
자세한 내용 보기

ftplib.error_perm: 550 Permission denied

The 550 Permission denied error in ftplib occurs when the FTP server denies access to the specified file or directory. This error can be caused by several issues such as: Incorrect file path or directory path on the server. Lack of write permissions for the specified directory. The FTP user does not have the required permissions to upload to the given directory. The remote directory may not exist. Steps to Troubleshoot and Resolve the Issue Here are some steps you can try to fix the 550 Permission denied issue: 1. Check the File Path and Directory on the FTP Server Make sure the remote path you are trying to upload to exists on the FTP server. If you're uploading to a specific directory, you may need to create it first. You can use the following code to list the files and directories on the server to ensure your paths are correct: from ftplib import FTP def list_files (ftp_host, ftp_user, ftp_password) : try : ftp = FTP(ftp_host) ftp.login(...
자세한 내용 보기

JAVA 실행 스크립트

JAVA 실행 스크립트 launch start script #!/bin/bash PRG="$0" INSTANCE="$1" CATALINA_HOME="/usr/local/tomcat" JAVA_HOME="/usr/local/java" LANG="ko_KR.UTF-8" PRGDIR="$CATALINA_HOME/bin" LOGDIR="$CATALINA_HOME/logs" EXECUTABLE=catalina.sh CATALINA_BASE="/www/tomcat/$INSTANCE" MEMSIZE=`cat /proc/meminfo | fgrep MemTotal | awk '{print$2}'` ((GB=$MEMSIZE/ 1000000)) if [ $GB -ge 4 ]; then XMS=2g XMX=4g else XMS=512m XMX=1g fi JAVA_DEBUG_OPTS=" -Xdebug \ -Xrunjdwp:transport=dt_socket,address=4102,server=y,suspend=n \ -Dcom.sun.management.jmxremote \ -Dcom.sun.management.jmxremote.port=8999 \ -Dcom.sun.management.jmxremote.ssl=false \ -Dcom.sun.management.jmxremote.authenticate=false" JAVA_OPTS=" -server -Dserver=$INSTANCE \ -Dfile.encoding=UTF-8 \ ${...
자세한 내용 보기

how to delete all issues on project in sentry, 센트리 이슈 삭제하기

As of now, Sentry doesn't have a direct feature to delete all issues in bulk through the web interface. However, there are a few methods you can use to archive, resolve, or delete issues programmatically or by adjusting project settings: 1. Bulk Archive Issues from the Web Interface Though there is no mass delete option, you can bulk archive or resolve issues, which essentially hides them from active issue lists. Steps: Go to your Sentry project. In the issue list view, select the issues you want to archive or resolve. Use the "Select All" checkbox to select multiple issues. Choose "Resolve" or "Archive" from the bulk action dropdown. However, this doesn't delete the issues permanently; they will be archived or marked as resolved. 2. Adjust Retention Policy (Data Retention Settings) If you're looking to remove older issues, you can adjust the retention policy at the organization level. Sentry allows you to configure how long issue...
자세한 내용 보기

Pyspark 를 사용한 테이블 조인, table join with pyspark

두 개의 HBase 테이블을 가지고 PySpark 를 통해 통계 데이터를 생성하려면 다음과 같은 과정이 필요합니다. PySpark와 HBase를 연동하려면 Spark와 HBase 간의 통신을 설정하고, 테이블 데이터를 불러온 후 필요한 통계를 계산하는 로직을 구현해야 합니다. 아래는 PySpark와 HBase 연동 및 데이터 처리 과정에 대한 전체 흐름과 예제 코드입니다. 1. 환경 설정 및 의존성 추가 Spark와 HBase 간의 통신을 위해 몇 가지 의존성 패키지가 필요합니다: hbase-client : HBase 클라이언트 라이브러리 hbase-spark : Spark와 HBase 간의 통합을 지원하는 모듈 다음과 같은 의존성을 Spark 환경에 추가해야 합니다: spark-submit \ --jars /path/ to /hbase-spark.jar,/path/ to /hbase-client.jar \ your_spark_script.py Spark 환경에 HBase 관련 의존성을 추가하지 않으면 PySpark 코드에서 HBase와의 연동이 제대로 동작하지 않습니다. 사용 중인 클러스터 환경에 따라 이 설정이 달라질 수 있습니다. 2. SparkContext 설정 PySpark에서 HBase와 연동하려면, hbase-site.xml 파일을 참조하거나 HBase의 설정을 명시적으로 지정해야 합니다. 이 예제에서는 SparkSession과 Hadoop 설정을 통해 HBase와의 연동을 준비합니다. from pyspark.sql import SparkSession # SparkSession 생성 (HBase와 통신 준비) spark = SparkSession.builder \ .appName( "HBase-Stat-Job" ) \ .config( "spark.hadoop.hbase.zookeeper.quorum" , "zookeeper-server...
자세한 내용 보기

Create fixed rounded button by Tailwind

To create a fixed, rounded button using Tailwind CSS , you can combine Tailwind's fixed utility (for positioning) with the rounded classes (for rounding the button). This is useful if you want a button that stays in a fixed position on the screen, such as at the bottom-right corner. Here’s how to do it: Example of a Fixed Rounded Button <button class="fixed bottom -4 right -4 bg-blue -500 text-white px -6 py -3 rounded-full shadow-lg"> Fixed Button </button> Explanation: fixed : Positions the button fixed relative to the viewport. It will stay in the same position even when the user scrolls. bottom-4 : Positions the button 1rem (16px) from the bottom of the screen. right-4 : Positions the button 1rem (16px) from the right side of the screen. bg-blue-500 : Sets the background color to blue. text-white : Sets the text color to white. px-6 py-3 : Adds horizontal ( px-6 ) and vertical ( py-3 ) padding for sizing the button. rounded-full : Mak...
자세한 내용 보기

To create a drawer in the footer using Tailwind CSS

To create a drawer in the footer using Tailwind CSS , you can make a sliding drawer that appears from the bottom of the screen when a button is clicked. Here's how you can create a footer drawer that slides up: HTML & Tailwind CSS Example for Footer Drawer <!DOCTYPE html> < html lang = "en" > < head > < meta charset = "UTF-8" > < meta name = "viewport" content = "width=device-width, initial-scale=1.0" > < title > Footer Drawer with Tailwind CSS </ title > < script src = "https://cdn.jsdelivr.net/npm/alpinejs@3.0.6/dist/cdn.min.js" defer > </ script > < link href = "https://cdn.jsdelivr.net/npm/tailwindcss@2.2.19/dist/tailwind.min.css" rel = "stylesheet" > </ head > < body class = "bg-gray-100" > <!-- Main Content --> < div class = "p-4" > < h1 class = "te...
자세한 내용 보기

Offset out of range error in Kafka, 카프카 트러블슈팅

The "Offset out of range" error in Kafka typically occurs when a consumer tries to read an offset that no longer exists on the broker. This can happen for several reasons, such as: The offset is smaller than the earliest offset available for the topic partition (i.e., the messages have been deleted due to log retention policies). The offset is larger than the latest offset available for the topic partition (i.e., the consumer is trying to read beyond the latest message). Steps to Resolve "Offset Out of Range" Error 1. Check Current Offsets Before making changes, it's useful to understand the current offsets and the offset range available for the topic partitions. Use the kafka-consumer-groups.sh script to describe the consumer group: bin/kafka-consumer-groups.sh --bootstrap- server localhost: 9092 --describe -- group <consumer- group -id> This command will show the current offsets, log end offsets, and the lag for each partition. 2. Reset the...
자세한 내용 보기

AttributeError: module 'numpy' has no attribute 'float'

The error AttributeError: module 'numpy' has no attribute 'float' occurs because the numpy.float , numpy.int , and similar aliases were deprecated in NumPy 1.20 and removed in NumPy 1.24. This issue arises when a package or script uses these outdated aliases. Here’s how to resolve it: 1. Identify and Update the Affected Code If this error is in your own code, replace numpy.float with the standard Python float type or the equivalent NumPy type: Replace numpy.float with float or numpy.float64 . Replace numpy.int with int or numpy.int64 . Example: # Before x = numpy.float( 10.5 ) # After x = float( 10.5 ) # Standard Python float # or x = numpy.float64( 10.5 ) # NumPy float64 2. Update the Dependencies If the error is coming from a third-party library, check if there is a newer version of the library that supports recent NumPy versions. Upgrade it: pip install --upgrade <package_name> 3. Use an Older NumPy Version (Temporary Fix) If u...
자세한 내용 보기

React datetime range picker

To implement a datetime range picker in React, you can use various libraries that provide this functionality. One popular library is react-dates . Here's an example of how you can use it to create a datetime range picker: First, install the required dependencies by running the following command: npm install react-dates moment Once the installation is complete, you can use the following code as an example: import React, { useState } from 'react' ; import { DateRangePicker } from 'react-dates' ; import 'react-dates/lib/css/_datepicker.css' ; import 'react-dates/initialize' ; const DateTimeRangePicker = () => { const [startDate, setStartDate] = useState( null ); const [endDate, setEndDate] = useState( null ); const [focusedInput, setFocusedInput] = useState( null ); const handleDateChange = ( { startDate, endDate } ) => { setStartDate(startDate); setEndDate(endDate); }; return ( < div > ...
자세한 내용 보기